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Four studies compiled in this document cover career 
awareness, academic achievement, career decision-making, and other 
ways of assessing effectiveness. Each area is developed through (1) 
literature reviews, (2) input gathered from state coordinators of 
career education and from local practitioners, and (3) reported data- 
which represents application of the specific treatment. The papers 
include data tables, bibliographies, and appendixes, in addition to 
extensive descriptions of projects reviewed for the studies. Major 
conclusions resulting from thei^e studies are reported as follows: (1) 
Educational programs designed to develop career awareness in students 
are maKing statistically significant changes in student development; 
(2) positive changes in the self concepts and work habits of some 
students have taken place, and further studies /ay net more hard data 
that career education can aid the development of students' 
acquisition of fundamental skills; (3) career education programs have 
the potential power to produce career decision- making effects which 
are specific and desirable, but a sound theoretical research base for 
prescribing an^d reporting decision- making activities seems lacking; 
and (4) students in grades K-12 generally respond positively to 
participation in career education programs and their attitudes appear 
to improve with increased exposure to career education programs and 
services. (TA) 
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THE EFFIGCZ OF CAREER EEXJCATION': 
CAREER AWARENESS 



by 

Elvis Arterbiiry 
John Collie 
Dave Jones 
Jayne Morcell 



INTRODUCTION 



The concept of career education has probably received 
more attention and created more discussion than any other 
concept to arrive on the American education scene in recent 
years. It is broadly supported by parents, educators and 
communities across the nation. 



The U. S. Office of Education under former Commissioner 

Sidney P. Marland, Jr., was largely responsible for the 

stimulation given to the idea of career education and while 

the Office tended to avoid suggesting any definition. Dr. 

Mar land wrote the following in American Education (1971) : 

. . .what the term 'career education' means to me 
is basically a point of view, a concept — a concept 
that says three things: First r that career education 
will be part of the curriculum for all students, not 
just some. Second, that it will continue throughout 
a youngster *£> stay in school, from the first grade 
through senior high and beyond, if he so elects. 
And third, that every student leaving school will 
possess the skills necessary to give him a start 
to making a livelihood for himself and his family, 
even if he leaves before completing high school. 



Many statements defining career education have been 
formulated. There tends to be generic elements within the vast 
majority of these definitions. For example. Dr. Rupert Evans 
(1972) stated, "career education is the total effort of the 
community to develop a personally satisfying succession of 
opportunities for service through work, paid or unpaid,* 
extending throughout life." In a policy paper of the U. S. 
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Office of Education (1974), "An Introduction to Career Education," 
Dr. Kenneth Hoyt, Director of Career Education, USOE, defined 
career education as "the totality of experiences through which 
one learns about and prepares to engage in work as part of her 
or his way of living." 

SCOPE OF THE PAPER 

There are coiranon elements and characteristics contained 
in many of the definitions of career education. One of these 
elements is referred to as career awareness. . The authors 
attempted to review all pertinent literature concerning the 
evaluation of the career awareness element of career education. 
A coordinated effort was made to systematically gather appropriate 
data. Personal visits were made to the U. S.. Off ice of Education 
and the National Institute of Education to review materials in 
their retrieval systems. Letters were sent to all state depart- 
ments of education requesting their assistance in the identifica- 
tion of exemplary programs in their state. Requests for data 
were then sent to the educators responsible for the identified 
programs. Participants in the Career Education Mini-conferences 
sponsored by the USOE Office of Career Education and numerous 
personal acquaintances were contacted. An ERIC search was con- 
ducted. These activities produced a large quantity of information. 
However, because of the diversity in conceptualizations, implementa- 
tion methodologies and evaluation designs, a comprehensive state 
of the art report was not feasible. The scope of this paper is 
therefore limited to a review of information that is representative 
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of the efficacy of the career awareness element of career 
education. Selected conceptual statements regarding career 
awareness from different sections of the country are identi- 
fied. Various techniques utilized to evaluate career awareness 
and the subsequent results are also addressed in this paper, 

CONCEPTUALIZATION 

The information reviewed reflected disparities in the 
conceptualization of career awareneL,s. Datta (1975) reported 
that theories of career development can be categorized into 
economic, psychological and sociological domains. The find- 
ings of the studies reviewed tend to support this view. The 
authors have presented selected conceptualizations as excunples 
of each theoretical domain. 

E conomic Based Conceptualizations 

The Curriculum Development Center, Vocational Education, 
University of Kentucky (1972) , described career awareness as "a 
knowledge of the total spectrum of careers." 

Psychological Based Conceptualization 

Herr (1972) stated that students need clarification of 
those aspects of the self — e.g. interests, capabilities, values — 
which need development for a lifelong process of planning and 
decision making. Within the individual must be fostered a 
conscious awareness that he does have a choicer 

Sociological Based Conceptualization 

Leifer and Lesser (1975) stated, "rarely are caraer choices 
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made by matching the demarids made by various sorts of work with 
the personal skills and interests of those selecting the 
occupation." While not developing a statement with regard to 
the specific term career awareness, Leifer and Lesser did 
identify elements of a desirable career education program. 
This program would for example include parental, peer and 
school influences; occupational models available in the 
community, including parents, relatives and neighbors; rate 
and direction of social mobility; and avaiir-ibility of training 
and apprenticeship opportunities. 

Many of the conceptualizations, however, tended to combine 
domains. In fact, the majority apptvired to be based on a 
combiration of psychological and economic theories. Representa- 
tive definitions of career awareness are described in the follow- 
ing paragraphs. 

The Business and Professional Women's Foundation (1974) 
stated: "Awareness involves those basic experiences that are 
introductory in nature' and is concerned with the development 
of attitudes, interests and elementary understandings as these 
relate to individuals as they learn about the world of work." 

According to Gibson (1973) , "At the career awareness 
phase of a school program emphasis should be given to attitude 
development, decision making, and self awareness as well as 
awareness of and knowledge about the broad characteristics and 
expectations of work." g 
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The National Institute of Education paper, "A 
Conceptual Framework and Rationale for the Career Awareness 
Divisionr" April 1975, cited four elements that encompass the 
conceptual ^limensions o£ career awareness. These were defined 
as follows: 

Occupational Knowledge ; factual information about 
the skill? and educational requirements of an 
occupation, the nature of the occupation in terms 
of its processes and products, its potential for 
access, advancements, and benefits. 

Occupational Preferences ; the set of occupation or 
adult roles which fall on a continuum of aspiration, 
preference, interest, or liking. 

Occupational Valu es: beliefs concerning the status 
of occupations and what an individual considers 
important with respect to aspects of V7ork and the 
place of work in adult life. 

Occupational Self Concept : beliefs an individual 
holds about the abilities he or she has and how 
successful he or she would be at an occupation 
or occupational role. 



Spradle (1973) referred to lifestyle in describing 
career awareness; 

Students must learn about the occupational cultures 
they will be a part of for any particular career. 
The world of work. . . iti a lifestyle, a set of 
values and assumptions. It means membership in a 
group with its own customs and mores. 



A report published by the Indiana State Department of 
Public Instruction (1973) described career awareness as an 
elementary program which would include self awareness and a 
realistic awareness of the world of work which will assist 
students in gaining respect for work and app eciation for its 
importance to our society. 
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The Houston Independent School Districc (1972) reported 
attempts: "To develop, at the elementary level, occupational 
awareness as an integral part of the instructional program so 
that each pupil may begin to develop self awareness and to 
formulate career thoughts, to ensure that eventually each 
pupil develops a clearer perc<=>ption of himself and sees him- 
self as a person of worth with a realistic and positive attitude 
toward becoming a prociuctive worker." 



Hoyt et al. (1972) summarized the thrust of the elementary 

school career education program: 

at the elementary school level, the components of 
career education most needed will emphasize helping 
students acquire positive attitudes- toward work, 
toward all levels of occupations found in the society, 
and toward themselves as prospective workers. 

The USOE (Hardwick, 1971) statement of career awareness objectives 

represents a conceptualization basically attainable at the K-6 

level. The objectives are: 

To develop in pupils attitudes about the personal 

and social significance of work. 

To help each student become av?are of himself 

as an individual and as a group member. 

To develop L-tudent awarene;:*-^ of many occupations 

and to expand the career aspirations of each 

student. 

To improve overall pupil performance by unifying 
and focusing basic subjects around a career 
development theme. 

In summary, the review of information indicates that there 
are various conceptualizations of career awareness. The majority 
are concerned with the various aspects of the world of work, 
attitudes toward work and knowledge of one's own capabilities, 
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values and interests. 

Although the career awareness element of career 
education has been described as a concept which starts in 
kindergarten and extends through life, the major emphasis 
appears to be at the elementary school level. 

A REVIEW OP EVALUATIVE STUDIES OF CAREER AWARENESS 

The purpose of this paper is to review representative 
studies that are indicative of the efficacy of the career 
awareness element of career education. In many instances the 
evaluation results reported were subjective in nature and did 
not provide quantitative information. The large number of 
studies in this category, however, represent a positive state- 
ment for the efficacy of career awareness. .Even though many 
of the applied evaluation techniques fall short of experimental- 
design evaluation standards, these studies should not be ignored. 
The salient fact is that, in almost all instances, the multitude 
of studies reviewed showed positive results. 

This section of the paper addresses the general state of 

the art in career awareness evaluation and presents quantitative 

studies which are indicative of the >$fficacy of career awareness. 

Eoyt (1975) alluded to the pressures which may result in the 

premature evaluation of education programs. 

The birth of a new idea properly precedes its 
expansion into an educational concept. The for- 



mulation of a new concept properly precedes a 
concern for testing its efficacy. Global evalua- 
tion of a concept's efficacy properly precedes the 
formulation and testing of research hypotheses 
aimed at discovering optimal ineans of implementing 
the concept in educational practice. The critics 
of a new idea in Education typically use, as one 
weapon, a call for definitive research results even 
prior to the time the idea has been developed into 
a tentative concept form. This short set of gener- 
alizations could, I believe, be illustrated repeatedly 
by those who study the history of new ideas in 
American Education. Career Education is only the 
latest example. 

A similar statement concerning evaluation of new education 

programs is reported by Datta (1975) who attributes to 

Timpane the notion that: 

...when an idea is sufficiently attractive, no one 
will wait for evaluation information before mounting 
large programs while if there is enough caution to 
give time for evaluative studies, no one will be 
really interested in the results. 

Datta further stated that lack of a research base describing 

the extent of the problem, lack of explicit and consistent 

objective statements, added to the technical limitations of 

measures of career development, suggest that programming has 

preceded ahead of the ability to evaluate program effectiveness. 



The problems resulting from inadequate measurement 
instruments and faulty evaluation techniques are definitely 
evident. Some researchers have reported partial success in 
measuring the area of career knowledge. However, attempts to 
measure such elements of career awareness as self concept, 
societal responsibilities and values have met with little 
success. 
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Raleigh County West Virginia (1972) educators "...recog- 
nized that the exemplary aspects of career education could not 
result in evaluation procedures and instruments could not 
objectively predict, assess or measure specific areas of 
career awareness..." and based their evaluation procedures 
on subjective information obtained from interviews with 
individuals and groups. A majority of the projects' results 
reviewed supported this position. Measures for objectives 
in the affective domain tend to be unavailable and measures 
to determine the impact of one variable on another appear to 
be even more difficult to obtain. 

In the cognitive domain problems also exist. Tuckman 

(1974) stated that: 

The measurement of career awareness, meaning know- 
ledge of career characteristics and requirements, 
necessitates a cognitive instrument dealing with 
specific careers. In terms of general career awareness, 
the problem becomes one of deciding which careers 
to ask questions about; in terms of specific career 
awareness, the difficulty lies in finding or building 
tests in the large number of career areas that students 
might choose to pursue. Instrumentation in this 
area is also hard to find. 

Wise, Charner and Randour (1975) indicate that the kinds of 
problems reviewed above result in an unequal handling of the 
measurement of career awareness. They maintain there is 
"a plethora of literature on educational-occupational aspira- 
tions and attainments, a small number of studies on occupational 
knowledge, and a paucity of research on occupational values and 
occupational self concepts." 

11 



ERIC 



Another aspect of the general problems associated with 
evaluation is the relatively low priority assigned to the collec- 
tion of evaluative data. Teachers and other potential users 
do not appear to recognize the positive benefits wjxich can accrue 
to them through timely program evaluation. There is a reason- 
able possibility that there is a direct relationship between 
inadequate instrumentation , poor evaluation techniques, unequal 
handling of variables, and educators' perceptions of a lack of 
worth in evaluative information. Two studies reviewed reflect 
the priority which teachers assign to evaluation. 

Holloway (1972) found that both elementary and junior 
high school teachers award low rankings to competencies which 
centered around evaluation, manpower trends and theories of 
career development. A 1974-1975 needs assessment survey of 
teachers in the Dallas Independent School District resulted 
in a similar low rating for evaluation. Dallas teachers re- 
corded a negative score (perceived negative need) for research 
and evaluation services. Only two of the fifty-six topics 
rated received lower need scores. 

A comprehensive review of career education project 
evaluations was conducted by Bruce W. Tuckman^and Joseph A 
Carducci (1974). Their report classified the evaluations 
into experimental and quasi-experimental evaluative studies 
(i.e. quantitative data utilizing experimental and control 
groups, pre- and posttests or posttest only design), descrip- 
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tive studies (i.e. quantitative data utilizing pre- and post- 
testing of treatment groups only) and case studies (i.e. treat- 
ment group only and qualitative data) • Chart 1 is a listing 
of studies taken from the Tuckman and Carducci study which deal 
with career awareness and self awareness. 

The following additional studies which are pertinent to 
career awareness and self awareness projed: evaluations were 
reviewed. For purposes of this report only quantitative 
evaluations are presented. 

The Pontiac Vocational Career Development Program (1971) 
attempted to increase the occupational knowledge and self 
concept of students. In evaluating the project the Occupational 
Knowledge Test {0,K,T,) and the Fantasy, Ability and Reality 
Scales {F,A,R,) were utilized. The three major findings were: 
(1) Students showed significant gain in their level of .occupational 
knowledge f (2) Upper elementary children showed greater gain in 
occupational knowledge than did lower elementary children, and 
(3) At the end of the program students selected occupations of 
higher rank than they did at the beginning of the program. 

Prince George's County Public Schools in Maryland (1975) 
included the following question in evaluating their career 
education program, "Do pupils involved in career education ac-. 
quire more knowledge about the world of work than do controls?" 
The results of their study found that at each grade level (with 
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CHART 1 



STUDIES REVIEWED BY TUCKMAN AND CARDUCCI RELEVANT 
TC CAREER AWARENESS AND SELF AWARENESS 



Author and 
Site of Study 

Cochian and We is 
(1972) Dayton, Ohio 



Grade 
Level 



9-10 



Instrument 

Ohio Vocational 
Interest Survey 



Analysis 

Analysis of 
covariance 



Holstein (1972) 
Lincoln Co., West 
Virginia 



1-6 Homemade test of Analysis of 

occupational covariance 
awareness 



Ovard (1973) 
Utah 



Not specified 



Chi square 



Sims (1973) 
Cleveland, Ohio 



5-6 



Job information 
questionnaire 



Analysis of 
variance 



McKulty (1974) 
Maissachusetts 



11-12 



Career Maturity 
Inventory 



Analysis of 
covariance 



Warren (1974) 
Kansas ' 



6-8 



Career Maturity 
Inventory 



t-test 



Eariolo (1972) 
Alameda Co., Calif. 



Elem. 



Occupational 

Information 

Survey 



t-test 



Cunningham (1973) 
New Britian, Conn. 



Elem. 



How I See 
MyseTf Scales 



Dennard (1973) 
Clayton Co. , Geo. 



Student Knowledge not specified 
of Careers 



Holden (1973) 
South Carolina 



Elem. A battery of 

cognitive and 
affective instru- 
ments 



not specified 



Peck (1973) K-9 Self Observation not opecified 

vistrict of scale 



Cclu2ri)ia 



Work Attitude not specified 

Survey 



7-9 Occupational not specified 

Values Inventory 

6-9 Career Awareness not specified 

Development 
In ventory 



Young (1971) 
New Orleans 



1-8 



Attitude Toward 
Work Inventory 



t-test 



Harmond (1973) 
Harrington, Maine 



Occupational^ 
KnowiedgT 



Test -.'f 



t-test 
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Findings 

"...student from the 
vocational school were 
better informed about 
career choice...** 

"...career education 
students outperformed 
control students on 
all measures. ** 

"... students showad 
favorable change in 
attitude toward work.." 

"... treatment schools 
students had acquired 
more job information 
than the control." 

"...positive correlation 
between scores for all 
students. 

"...significant differ- 
ences in mean scores in 
favor of treatment group." 

"...yielded greater gains 
for treatment students 
than for controls at 
elementary level." 

"...showed significant 
differences between the 
control and experimental 
groups." 

"... fourth graders in 
program had greater 
knowledge of ceureers 
than those not in 
program. " 

"Kershaw and Chester- 
field counties were 
fairly successful in 
efforts to teach elemen- 
tary school students 
about careers." 

"...showed CDEP children 
to have better self- 
concept than controls." 

"...revealed CDEP students 
had more positive atti- 
tudes toward work than 
controls." 

"...students were realis- 
tic in their career plan- 
ning . " 

"...students were able to 
relate school-learned 
skills to work situations 
at reasonable level of 
proficiency." * 

"A significant positive 
gain was found for 
students in grades 1-8." 

"...significant gain 
in mean scores of 
seventh grade students." 



the exception of ninth g-rade) the experimental groups scored higher 
than the controls. Statistical significance was reached at grade 
levels 6, 1, 11 and 12. 

" The Career Based Curriculum Project in Monroe r North Carolina 
(1975) evaluated two goals for their elementary program relative 
to self awareness and career awareness. Goal 1: To increase each 
child's self awareness, encouraging a positive self concept. The 
Self Observation Scales (SOS) were used to measure the students* 
self a^jareness. Statistically significant differences occurred on 
six of the eight scales for third graders. Goal 2: To increase 
the pupils* awareness of the many occupations and job roles in the 
community. This goal was measured by asking the students to "list 
as many kinds, of workers as you can." Students in the third grade 
Project schools listed more at the .05 level, than did third 
graders in the control schools. The mean number of workers listed 
by sixth graders in Project schools was significantly higher than 
sixth graders in the control schools at the .01 level. 

The Research and Development Project in Career Education in 
Wichita, Kansas utilized the Career Knowledge test at the primary 
level in the pilot elementary schools. The Occupational Similarities 
Scale showed a significant difference at the .05 level between pre- 
and posttests on students at the K-2 level. At the Intermediate 
level (3-6) the Orientation of Career Concepts (OCC) was ad- 
ministered and statistically significant differences were found 
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on the Vocational Vocabulary Scale (.01), the Working Conditions 
Scale (.05) and the Worker's Earnings Scale (.05). 
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Unified School District No. 250 of Pittsburg, Kansas 
utilized the Self Observation Scales and the Career Maturity 
Inventory to evaluate their career education programs. 
Approximately 200 students randomly selected from all six of 
the elementary schools in Unified School District No. 250 were 
tested as the experimental group. A parochial school which did 
rrot have a career education program was used as a control group. 
At grade three the results of the Self Observation Scales showed 
that out of eighteen possible comparisons (i.e. six schools x 
3 scales) the schools in the Unified School District No. 250 
exceeded the national norm of fifty and the average percentile 
score of the control group in twelve cases. At grade six the 
results show that of a possible thirty comparisons (i.e. six 
schools X 5 scales) the sixth graders exceeded the national 
average of fifty in twenty-four of the thirty situations. The^e 
students also exceeded the average percentile score of the control 
group in twenty-eight of the thirty comparisons. The evaluation 
of the ninth graders used the Career Maturity Inventory and a 
statistically significant difference was found between the 
experimental and control groups on Part 2: Knowing About Jobs. 

A report on a Research and Development Project in Career 
Education (1974) from the Department of Education in Pennsylvania 
presents a study to determine the effects of project activities 
on the children involved. Matched samplings of third and fifth 
grade students were compared. The comparisons, made between 
highly involved and moderately involved . students, revealed that 
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the third graders who were highly involved could list more 
occupations in one minute than their less involved counterparts. 
The highly involved fifth graders were superior to the moderately 
involved group with respect to self concept development and 
attitude toward school. 



Behavioral Research Associates evaluated the Pima County 
Developmental Career Guidance Project (1975) • They concluded 
that: 

Students exposed to career education demonstrated a greater 
awareness of the world of work. On every index designed 
to measure career- awareness, economic-awareness, and de- 
cision-making, the students with career education exposure, 
scored higher. One of the most consistent findings in the 
data is that students with career education exposure are 
more knowledgeable about a variety of occupational clusters, 
representing the entire range of jobs. This finding reflects 
favoi§a±)ly on the Arizona Career Education Effort, a*nd high- 
lights one major goal of career education which is to expand 
the students' conceptualization of the economic marketplace* 

Students exposed to career education: (1) have knowledge 
of a wider range of occupations both between and within 
occupational categories, (2) have more ability to evaluate 
the skills needed in preparation for certain occupational 
choices, and (3) have more self-confidence that their goals 
are both realistic and achievable. 

Pima County also includes an evaluation of self awareness. Their 

findings suggest: 

One of the most promising findings this year is related to 
the area of self awareness. Students in the high career 
education group were more certain of attaining their educa- 
tional and occupational aspirations, rated themselves 
favorable relative to other students in their grade level, 
and expected higher achievement for themselves compared to 
students in the low involvement group. Since there were no 
population differences in the two groups, these data demon- 
strate project efforts in the area of self awareness have 
had some success this year. Efforts should continue along 
these lines next year, since the findings this year are more 
significant in the trend that is seen, rather than in the 
statistical differences between high and low exposure students 
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"An Evaluation of Vocational Exemplary Projects" was pre- 
pared by Development Associates, Inc. (1975). Forty-five projects 
were studied utilizing a variety of measurement i ^» st rumen ts in- 
eluding the Career Maturity Inventory to determine significant 
differences between participants on eight outcome questions relevant 
to the study. Chart 2 is taken directly from their report to show 
the findings of the evaluation. 



— ^ CHART 2 ' 

summary of Conclusions for Outcome Questions Across all Projects by Student Group* 




Outcome Questions ^ = 

Are student participants ^ble to identify 
a greater number of occupations than 
non-participants? (Ql) 

Do students demonstrate more familiarity 
with tasks and functions associated 
with selected occupations than the 
comparison group? (02) 

Are student participants more familiar 
with the requisites associated with 
selected occupations than the com- 
parison group? (Q3) 

Do student participants score higher 
on pre-vocGtional/, :30b readiness 
tests than the comparison group? (Q4) 

Do student participants indicate more 
positive attitudes toward employment 
than non-participants? (Q5) 

iSi the variety of careers being 
considered by individual participating 
stuc'ents greater than that of students 
in tne comparison group? (Q6) 

Do more student participants indicate 
having a career plan than the comparison 
group? (Q8) 

Do more student participants cite their 
career preference as their expected 
career than non-participants? (QlO) 



Yes 



No 



Yes 



Yes 



Yes 



No 



9th 
Grade 



tarticioatingl CounseiingI Worx | Skill 

Teacher I Group experience Training 



Yes 



Yes 



No 



NO 



NO 



NO 



NO 



12th Grade 



Yes 



Yes 



NO 



NO 



Yes 



No 



Yes 



No 



Yes 



Yes 



No 



NO 



NO 



No 



NO 



Yes 



No 



NO 



No 



NO 



NO 



NO 



NO 



NO 



NO 



NO 



NO 



NO 



NO 



NO 



NO 



Yes 



.The questions were answered "yes" there was an derail significant difference in favor of 
participants for any of the criterili used to assess the question. 
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A Study was conducted in three elementary schools in the 
Fort Osage Public School District R-l, Independence, Missouri 
(1974) . The purpose of the study was to test the effect of in- 
service teacher training in career education on the achievement 
of students. The study consisted of two experimental treatments 
(Methods A and B) and a conventional treatment (Method C) . Method 
A refers to the approach to teaching selected career education 
concepts by teachers who had received a three-week orientation to 
the career cluster concept and who had written curriculxim oriented 
to the cluster concept over an additional three-week period. 
Method B refers to the teaching of selected career education con- 
cepts by teachers who had received a three-hour orientation to 
the career cluster concept, who had not written curriculum oriented 
to the career cluster concept, but who taught the curriculum which 
had been developed by their colleagues in Method A. Method C re- 
fers to the conventional approach to teaching fourth and fifth 
grade elementary school students. The teachers were encouraged 
to teach the concepts of career education but were given no 
assistance in securing career-oriented career units developed by 
their colleagues in Method A. A-s a result of testing, the students 
who experienced Treatments A and B made significantly higher gains 
in achievement of career awareness and self awareness. 

Wes thorough Junior High School, South San Francisco provided 
the evaluation data on their Career Education Project (1975) . 
They give the percent average loss or gain on pre- and posttests 
of the target school and the control schools on three scales: 

22 

19 

O 

ERIC 



self -awareness, occupational information and school/college 
information. The results are shown in Chart 3, 



'CHART 3 

Project 1690 ; % loss or gain shown between September 1974 Pretesting and Posttesting , May 15, 1975 

SUMMARY OF COMPARISONS BETWEEN TARGET AND CONTROL SCHOOLS 

MATCHED POPULATIONS 
TARGET SCHOOL - CONTROL SCHOOL 



SELF-ASSESSMENT QUESTIONS 



7tn 


Grade 

TOTAL AVERAGE 


LOSS OR GAIN 


+19% 


7th 


Grade 


TOTAL 


AVERAGE 


LOSS 


OR 


GAIN 


* +23% 


8 th 


Grade 

TOTAL AVERAGE 


LOSS OR GAIN 


+19% 


8th 


Grade 


TOTAL 


AVERAGE 


LOSS 


OR 


GAIN 


-6% 


9th 


Grade 

TOTAL AVERAGE 


LOSS OR GAIN 


+ 26% 


9 th 


Grade 


TOTAL 


AVERAGE 


LOSS 


OR 


GAIN 


+14% 




OCCUPATIONAL INX- - / 


ATION QUESTIONS 




















7 th 


Grade 

TOTAL AVERAGE 


LOSS OR GAIN 


+17% 


7 th 


Grade 


TOTAL 


AVERAGE 


LOSS 


OR 


GAIN 


-8% 


8 th 


Grade 

TOTAL AVERAGE 


LOSS OR GAIN 


+ 17% 


8 th 


Grade 


TOTAL 


AVERAGE 


LOSS 


OR 


GAIN 


+3% 


9th 


Grade 

TOTAL AVERAGE 


LOSS OR GAIN 


+21% 


9 th 


Grade 


TOTAL 


AVERAGE 


LOSS 


OR 


GAIN 


+16% 




SCHOOL/COLLEGE 


INFORMATION 




















7 th 


Grade 

TOTAL AVERAGE 


LOSS. OR GAIN 


+ 15% 


7 th 


Grade 


TOTAL 


AVERAGE 


LOSS 


OR 


GAIN 


+2% 


8 th 


Grade 

TOTAL AVERAGE 


LOSS OR GAIN 


+16% 


8 th 


Grade 


TOTAL 


AVERAGE 


LOSS 


OR 


GAIN 


+2% 


9 th 


Grade 

TOTAL AVERAGE 


LOSS OR GAIN 


+ 37% 


9th 


Grade 


TOTAL 


AVERA<=£: 


LOSS 


OR 


GAIN 


+17% 
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Behavioral Research Associates prepared the evaluation report 
of the Cochise County Career Education Project (1975). Chart 4 
presents the results of the evaluation showing significant differ- 
ences on all variables between a high exposure to career education 
sample and a low exposure sample. Cochise County also includes an 
»^valuation of self awareness. Self awareness is measured by the 
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student's responses to four questions. One question covers self 
expectations for school performance. Another question asks the 
students to compare themselves with other students in terms of 
how right they are. The remaining two questions deal with the 
student's certainty of attaining educational and occupational 
aspirations. The reVu Its "indicate that students in the high 
exposure sample were consistently more positive in terms of 
self awareness than the students in the low exposure sample 
as measured by the four questions. 

Chart 4 

COMPARISONS OF STUDENTS WITH HIGH AND LOW EXPOSURE TO CAREER EDUCATION ON SEVERAL DIMENSIONS 
RELATED *T0 THE ARIZONA CAREER 7JDUCATI0N MATRIX 



High Exposure 
Sample 



Low Exposure 
Sample 



t-test Signif icemce 



Career 
Awareness 



Economic 
Awareness 



Career 
Awareness 



Educational Awareness 



Secondary Students 
46.8 



Knowledge of Skill Req. 
Knowledge of Factors 

Contributing to Job Satisfaction 
Common Threads in Jobs 



Economic Awareness 
Awareness of Career Mobility 
Awareness of Factors Influencing 
Occup. Structure 



Decision Making 
Employability Skills 
Appreciations and Attitudes 
Knowledge of Career Clusters Score 
Interest in Career Clusters Score 



54.5 

63.8 
68.2 



53.1 
40.9 

53.2 



35.3 
26.6 
45.3 
34.2 
25.9 



Elementary/Intermediate Students 



Educational Awareness 

Knowledge of Skill ReQ. 
Knowledge of Factors 

Contributing to Job Satisfaction 
Common Threads 



Economic hwai:eness 
Decision Making 
Appreciation and Attitudes 
Knowledge of Career Clusters Score 



50.1 

59.4 

54.6 
65.7 



58.2 
61.5 
60.2 
49.9 



44. 3 

49.6 

55.7 
57.0 



48.5 
34.0 

47.7 



30. 2 
24.4 
37.0 
30.8 
?.4.7 



48.5 

50.5 

48.5 
59.8 



52.6 
54.7 
54.9 
44.8 



3.01 

2.40 

3.40 
4.64 



1.83 
2.78 

2.27 



2.94 
3.04 
3.90 
1.85 
1.97 



1.86 

3.45 

2.57 
2.1^ 



2,24 
2.67 
2.01 

2.28 



0.001 

0.01 

0.001 
0.001 



0.04 
0.003 

0.002 



0.001 

0.001 

0.001 

0.04 

0.025 



0.05 

0.001 

0.005 
0.01 



0.01 
0.005 
0. 020 
0.01 
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SUMMARY 

The purpose of this paper was to review existing evaluative 
studies that are indicative of the efficacy of the career awareness 
element of career education. The studies discussed represent a 
sampling of the degree of success achieved by educators in 
implementing and evaluating career education across the nation. 

The information revealed that there is general agreement 
with regard to definitions of what career education means. However, 
conceptualizations, of career awareness and other elements of career 
education are more diverse. As more specific objectives, program 
implementation and evaluation are addressed less agreement and 
greater disparities appeared. 

Most practitioners include varying aspects of psychological 
and economic theoretical domains in their conceptualizations of 
career awareness. Tho sociological domain is much. less prominent 
among the studies reviewed. 

It is evident that program development and implementation 
are well in advance of evaluation and assessment. There is a 
tendency to assign a low priority to evaluation and problems 
exist with evaluation design and measurement instruments. 
Several factors contribute to these difficulties. Teachers 
do not recognize the potential value of evaluative studies. 
There is considerable lack of specificity among objectives 
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which have been identified under the career awareness concept • 
Measurement methodologies are varied and few standardize"?! 
instruments are availcible. Measures for objectives in the 
affective domain tend to be unavailable and measures to 
determine the impact of one variable on another appear to 
be equally scarce. There is an unequal handling of the 
measurement of career awareness. 

Although not exhaustive, the studies referenced, in 
this paper are descriptive of the extent to which the concept 
of career education and, more specifically, career axvareness 
programs are producing quantative data for evaluation purposes.' 
Subjective evaluations of programs tend to be positive and the 
participants %eere favorably optirais^ic about the total effort. 
Analysis of the information accumulated reveals that adequate 
evidence is available to support the position :piiat education 
programs designed to develop career awarenesis in students can 
make a differences Based on the studies, presented it can be 
concluded that regardless of the variety of definitions, the 
variety of implementation methods and the variety of evaluative 
techniques, career education is making statistically significant 
changes in student development. 
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INTRODUCTION 



On January 23, 1971^ Commissioner of Education Sidney P. 
Marland, Jr. (1971), in his speech entitled "Career Education Now," 
delivered to the Convention of the National Association of 
Secondary School Principals in Houston, Texas, launched career 
education into the mainstrecim of educational thought. In the 
approximately five years since that time career education has 
progressed from a much-discussed idea to many well-developed 
programs have not been functioning very long, it is possible for 
them to have had an impression on students. 

What data are there regarding the effects of career education 
on students' academic achievement? Is career education enabling 
the student to successfully meet his goals in school? Exactly 
what are the goals in Americem education? In the early nineteen 
hundreSs, the seven cardinal principles of education espoused by 
the Commission for the Reorganization of Secondary Education (1918) 
defined the role that the school should play in the teaching of 
the student. Even at that time, emphasis was placed on "vocational 
preparation, citizenship, and the worthy use of leisure time." 

A few years later, Dewey (1931) expressed the view that school 
subjects could be correlated with industrial education if educators 
gave priority to educational values rather than industrial or 
vocational goals. He indicated that the educational values would 
familiarize the learner with the social and cultural background 
of his vocation as well as the skills involved. 
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As time passed , the emphasis in education shifted from the 
fulfillment of societal needs to the desire to fill the needs of 
the student. Therefore, in the 1930 's and 1940' s, the -experiences 
of the learner were stressed. Unfortunately , "exp^jriences" is a 
rather broad, undefined! term so that although the child was the 
original prime consideztHtion, experiences were simple justified 
for their own sakes. There were no means to adequately measure 
them. 

The beginnings of the space age in the 1950' s, however, 
brought about an abrupt change in educational concern. The child 
was still considered important, but his needs were actually placed 
in a secondary position to society's needs for him. The student was 
saturated in the sciences, math-- all the technological fields 
that would enable the United States to keep up with her global 
neighbors.. There was numerous ideas, principles, and theories 
that the. school should teach and- which the child should learn, 
whether his personal goals included the need for that knowledge 
or not. 

Recently the emphasis changed once more. The public is 
demanding that schools be accountable and that education be relevant 
to the student. As a result of these demands, the 1960 's and 
70 's saw an increase. in innovative teaching strategies, such as 
individualized and personalized instruction, computers-assisted 
instruction, and utilization of multimedia. Since the goal is to 
teach the concepts that the individual learner needs the most, 
it is only logical for career education to be in the forefront. 

37 



36 



Proponents of career education stress the need to enable 
students to acquire the necessary academic skills and attitudes 
about work, leisure , and education so that they can adapt to change , 
can be skilled in certain career areas that best suit their 
abilities and interests, and can be mentally acceptant of furthering 
their education and retraining for jobs throughout life. Because 
of the rate of change in today's society, it is illogical to 
assvune that any educational program is terminal. In order to be 
better prepared to cope with change, young people need not only 
to become cognizant of the effects of technology on people's 
occupations and lifestyles, but they must develop also a strong 
foundation in basic skills. Skills in planning, predicting, 
creating, and adapting will become basic skills in a school 
context, according to the Texas Association for Supervision and 
Curriculxim Development Task Force in School Curriculuitt Design 
for the 1980' 3 . Opportunities must be provided for. students to 
develop attitudes that will contribute to self esteem and 
flexibility as well as a strong foundation in academic skills, 
. Basic skills are essential to each individual as he or she develops 
for his or her respective role in society. In the Fourth Annual 
Gallup Poll of Public Attitudes Toward Education (1972) , the 
number one priority among respondents was that the schools should 
teach students the skills of reading, writing, and arithmetic. 

Gene Bottoms (1972) views as one necessary objective of an 
elementary career education program enhancing students' acquisition 
of basic academic skills. This, in his opinion, can be done by 
providing an alternative to the more abstract learning style which 
has dominated as an approach to education. 
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What exactly is the relationship between career education and 
academic skills? Of the developmental tasks (Havighurst, 1964) 
that the child is to learn during middle childhood and adolescence, 
some of the most important are the acquisition of the fundamental 
skills in reading, wilting, and calculating, the concepts necessary 
for everyday living, the selection end preparation for an 
occupation, and intellectual skills and concepts necessary for 
civic competence. Those tasks listed above are quite relevant 
to the work of educators at the elementary and secondary levels. 
When educators are aware of these tasks, they are better equipped 
to help a student identify his purpose for being in school and to 
see the best times to introduce certain tasks to the growing 
child. Once the student begins to master these different tasks 
such as the use of words and knowledge of the things for which 
they are symbols, he is better able to differentiate and integrate 
the world around him. As O'Hara (1968) pointed out, the more 
occupational words a student knows, the more he will be able to 
differentiate and integrate within the occupational world. 
However, since people of the world outside the classroom also make 
g^eat use of symbols in the auditory and visual realm, it is 
crucial that the stxident also become auditorially and visually 
literate. Thus, the fvindamental skill of communication includes 
communication in ail its forms— print, auditory, and visual. 
Communication and computational skills are identified by career ^ 
education writers as the most marketable skills that the schools 
can help the student acquire. 

In agreement, Leighbody (1968) has stressed the fact that 
academic learnings constitute not only the indispensable foundation 
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for job training and job security but are, in themselves, the most 
salable and most enduring job skills that a worker can possess. 

In order to aid the student in accomplishing the necessary 
developmental tasks, varying career education programs have been 
instituted. Some schools have implemented separate courses at 
the secondary school level while others have organized units of 
work around the fifteen occupational clusters. The approach 
utilized by a large number of schools currently is that of the 
infusion of career education concepts into the ongoing curriculum. 
Infusion, according to Katz (1973) is not a fixed treatment. 
It is a variable responsive to individual need and uses. 

Is the current emphasis on career education affecting students' 
success in academic areas? I*^ is the purpose of this paper to 
report the findings pertinent to the effectiveness of career 
education efforts as reflected in the achievement of students in 
academic areas.. 

Good (1973) defined academic achievement as students' knowledge 
attained or skills d^^eveloped in the school subjects, as designated 
by test scores or by marks assigned by teachers, or by both. An 
extensive survey was made of available studies reporting the 
evaluation of academic achievement of students in school-based 
programs 5 kindergarten through grade twelve, and students in 
school-based programs, kindergarten through grade twelve, and 
students in experience-based career education programs. Primary 
emphasis is given in this paper to studies in which experimental 
and quasi-expe>rimental designs were employed and the analysis 
of "hard data" was reported. Since the informational needs of the 
local practitioners differ from those of educational planners 

39 

ERiC 40 



at the state and national levels, some data which does not meet 
local needs but not the rigorous standards of scientific 
investigation are briefly reviewed. 

Examination of studies relating to the effects of career 
education programs on academic achievement was largely restricted 
to those studit^s which included data collected between 1972 and 
1975. Few of the goals and objectives given for the implemented 
programs included statements regarding students' achievement in 
the academic areas. Understandably, few program evaluations included 
data relative to such achievement. 

In order to obtain the information herein reported, the 
following methods were utilized: three searches of the ERIC 
system were requested; the Washington, D.C. offices of Development 
Associates, Inc., National Institute of Education, Office of 
Career Education, and the Office of Vocational Technical Education 
were visited; letters were written to all participants in OE's 
1974 Career Education Mini-Conferences and to all projects and 
individuals named by Mini-Conference respondents; materials sent in 
response to letters to state coordinators of Career Education; 
telephone calls were made to all regional offices of the U. S. Office 
of Education. Telephone conversations were conducted with project 
directors and school administrators in a number of locations 
throughout the nation. With two excsptions, all of the project 
people who were asked to supply information did so. 
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REVIEW OF STUDIES 

During the 1974-1975 school year a main thrust of the elementary 
school level career education program of the Ceres f California, Uni- 
fied School District (1975) was the determination of the impact of 
the program on academic achievement. The overall gain made by pupils 
in grades one through six in reading was twelve percent. In math a 
gain of eleven percent was indicated. Using chi-square, a comparison 
was made of the percentage of students scoring on or above grade 
level on the Cooperative Primary Text and the Comprehensive Tests of 
Basic Skills (grades 4-6) in May, 1973 and May, 1974. 

The percentage of students scoring at or cibove grade level in 
1973 and 1974 is shown on the following table, along with the percent- 
age of gain.* 

MATH . 

Percentage at Percentage at 

or above grade or above grade Percent 



Grade level 1973 level 1974 of Gain 

1 31 52 21 

2 32 32 NG 

3 29 " 46 17 

4 25 . 29 4 

5 23 32 9 

6 28 34 6 



* Information given via telephone by Virginia Lish, Curriculum Specialist 
Ceres 
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READING 



Grade 


Percentage at 
or above grade 
level 1373 


or above grade 
if^vf^l 1974 


Percent 
of Gain 


1 


33 


52 


19 


2 


27 


34 


7 


3 


26 


30 


4 


4 


24 




J. J. 


5 


15 


35 


20 


6 


28 


36 


8 



The foregoing information was gathered during the third year of 
a three-year project designated CERES (Career Education Responsive to 
Every Student) . Approximately two thousand elementary students were 
included in a general impact program,- with about forty percent of the 
students participating in a concentrated career education program. 
Teachers of children in the experimental group were involved in a 
staff development program during which they analyzed career education 
objectives as well as the reading and math needs of students in their 
classrooms. The teachers, who also learned to utilize an infused 
approach to curriculxam development, had consultant help available 
from elementary principals, resource teachers, and a curriculxam 
specialist. 

David Huffman (1975) of Pittsburg, Kansas, sent a letter 
along with the report of a project being conducted under Part D of 
Public Law 90-576. Mr. Huffman wrote: "It was interesting for us 
to note that all those activities we have involved teachers and students 
in during this school year (by activities we mean those experiences 
we call part of our career education emphasis) did not take away from 
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academic achievement r but in fact, achievement gains were signif icant, " 
In the project schools an analysis was made of students' scores on 
Metropolitan Achievement Tests which were given in September, 1974 , 
and April r 1975. A distribution of frequency for both pretest and 
posttest scores of 233 third-grade students was compiled, and this 
was tested for significant differences using a chi-square procedure. 
Statistically, the difference in frequency between the pretest and 
posttest was significant at the -001 level (p ^.001) on all nine 
tests. The third grade of a parochial school which did not have 
career education was used as a control group. It was concluded 
that there was no statistical significance between the scores of 
the two groups; the academic achievement of third graders in Unified 
School District No. 250 (Kansas) was equal to that achieved by 
students in the parochial schools of the community. 

The pretest and posttest scores of 261 sixth graders were 
compared in a manner similar to that used with the third-grade scores. 
In the test for language the distribution of scores was not statis-' 
tically significant, but it is noteworthy that the group mean was 
6.2 (grade equivalent) in September and 6.7 in April. In nine other 
subtests the differences between pretest and posttest scores were 
statistically significant at the .05 or higher level of confidence. 
Six of the tests were significant at the .001 level (p < .001). It 
was concluded that there were no statistically significant differences 
between the academic achievement of the experimental and control groups. 
The overall academic achievement of sixth graders in the experimental 
group was comparable with that of students in the control group. 
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Of thirty possible comparisons , on the Self Obseirvation Scales/ 
the sixth graders in the experimental group exceeded the national 
average percentile of 50 in 24 of the 30 situations. They also 
exceeded the Average Percentile Score of the control group in 28 of 
the 30 comparisons on the scales. 

Ninth-grade students in the career mathematics classes were 
given the ABLE test, forms A and B, as pretests and posttests to 
determine their achievement in mathematics skills. The instrximent 
used is a standardized test covering thirty areas of mathematics. 

A frequency distribution was compiled for four groups totaling 
fifty-four students for the pretest and posttest- The difference 
between the pretest and posttest distribution of scores was signifi- 
cant at the .001 level (p < .001) of confidence. 

In Prince George's County, Maryland (1975)/ a study was conducted 
to determine the effects of integration of career education into the 
existing instructional program of selected schools. A primary focus 
was upon the effects which the career education program had in the 
area of basic educational skills. 

The school staff in each participating school determined the 
method of implementation of the career education program. Classroom 
guidance/ workshops, and limited financial assistance were provided 
by the school system to facilitate the integration of career knowledge, 
job attitudes, community /parent visitation program into the curricula. 

Classes of grades 1, 3, 6, 7, 9, 11, and 12 of fourteen schools 
were selected for study. Schools which were used as controls were 
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matched with the experimental schools on five variables. Individual 
classes were combined across schools within grade levels to form 
experimental and control groups. 

Thirteen data-gathering techniques were utilized in addition 
to the Iowa Tests of Basic Skills and the Iowa Tests of Educational 
Development. Posttests were given during the last school month of 
the 1973-1974 school year. The primary analysis techniques were the 
one-way analysis of variance and two sample tests. 

The experimental samples scored significantly higher (p ^.01) 
in reading arid arithmetic than the controls. Exceptions were sixth- 
grade reading and senior high language usage and social studies. The 
writers recommended that follow-up evaluations include a pretest- 
posttest design in order to assure that equivalent groups are used 
and that differences found on the posttest can be tied better to the 
effects of career education. 

The comprehensive career education model implemented in the 
schools of Lincoln County, West Virginia, is described in a monograph 
by Olson (1974) . The three-year program was initiated in eight 
elementary schools, grades one through six in 1971. Of the student 
population, 887 students were involved in the career education program 
and 1/549 were not. 

Staff development activities were provided for twenty-nine faculty 
members who subsequently implemented career education in their classes. 
Teaching strategies of field trips, resource role models, manipulative 
activities, simulation, and multimedia activities were incorporated 
into instructional resource units utilized with the experimental groups. 
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Posttest data were analyzed for 415 students who, in May, 
1972, were given the California Language Achievement Test and the 
California Mathematics Achievement Test. The experimental students 
were randomly selected from intact classes of students involved in 
the Career Awareness Program while the control students were 
selected from the remaining students who had not participated in 
the Career Awareness Program. 

In order to provide for an unbiased comparison of the effects 
of the treatment, the analysis of covariance was employed. The 
adjusted posttest means for the experimental group were 11 percent 
higher than the adjusted posttest means for the control group on 
language achievement . 

Data produced from the analysis of covariance on mathematics 
achievement indicate that the difference between the experimental 
group and the control group was significant at the .01 level 
(p < .01). The adjusted posttest means for the experimental 
group were 24.5 percent higher than the adjusted posttest means 
for the control group on mathematics achievement. 

Among the implications based on the finding of the study were: 

(1) "utilizing experimental activity to illustrate 
abstract symbols and concepts related to career 
education goals (life goals and academic sijbject 
goals) is an effective method of increasing 
academic achievement, and (2) in-service education 
which focuses on both process (human relations) and 
task (planning, development, implementation) compo- 
nents is effective in delivering career education 
activities to elementary and secondary students." 
(Olson, p. 21) 

An exemplary project in career education began in July, 1974, 
in the Union County Schools of North Cexolina (1975). According to a 
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publication supplied by Dr. John Moore, the project was funded under 
Part Dr Public Law 90-576, and was aimed at implementing a career-abased 
curriculum. During the 1974-75 school year^ twenty elementary , middle, 
and secondary schools were involved. 

Major program activities during the first year included staff 
development for personnel at all levels , development and imple- 

mentation of curriculum units stressing integration of career education 
into the academic disciplines r provision of group guidance and the 
establishment of a career center in the library. 

Use of the community as a classroom was stressed for all grade 
levels of the participating schools. At the elementary school level, 
the academic instruction was to be rela-^ed more closely to the "World 
of Careers" through a Career and. Selt-Awareness Program. In the middle 
schools, a Career Exploratory Program included a "hands-on" approach 
in fifteen occupational clusters, a Guidance and Counseling Program, 
and Instructional Modules which related to students' academic and 
career-exploratory experiences. 

The research question posed, which is pertinent to this paper, 
was: Have student grades, attendance, achievement, and attitudes 
improved as a result of the Career Based Curriculum? A pretest-post- 
test design was not possible; data were collected in the spring only. 
Reading and mathematics achievement test results from September, 1974, 
and March, 1975, were available and were utilized. Scores were expressed 
in grade equivalents. 
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From a student population for grades K-8 of approximately 
3r000^ students in grades 3, 6, and 7 were randomly selected. From 
schools identified as having students comparable to those in the 
project schools f sixty third graders and sixty sixth graders were 
randomly selected. Twenty-five seventh graders were chosen from the 
two control schools. 

One-way analysis of variance and multiple regression were 
applied to the data. Mean grade equivalents were the same for all 
groups in September for reading and mathematics. Althoujh the 
third-grade project group achieved slightly more than the control 
group in both reading and math, the differences were not statisticall 
significant. At the sixth-grade level, the difference between the 
two groups in reading was statistically significant, with the difference 
favoring the experimental group. Although the difference between the 
two sixth-grade groups in mathematics was not statistically significant, 
the experimental group showed a greater gain. 

A descriptive evaluation was given by Lapinski (1972) of an 
interdisciplinary career assessment program for fifty-four slow learners 
and disadvantaged youth at the high school level in Stamford,, Connecti- 
cut. The cluster c- Acept and correlation of classroom materials to 
occupational assessment and skill training were essential to the program. 
One objective of the program was the development of basic skills; in 
one part of the evaluation, the Science Research Associates' Basic 
Skills in Arithmetic Test were used as pretests and posttests. 
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The sixty-four students in the study showed an average gain 
of !•? years at the ninth-grade level and 1.3 years at the tenth-grade 
level. The ninth-grade gains ranged from 1.0 to 3.7 years; the 
tenth-grade gains from 0.0 up to 2.8 years* At the conclusion of 
the study r the arithmetic scores of the group of slow learners 
and disadvantaged stiidents ranged from 5.6 to 10.5 for ninth graders 
and 4.6 to 9.9 for tenth graders. 

The study which is descriptive in nature cannot provide a basis 
for comparison of results such as can be provided by a control group. 
The researcher did report that a check of five students who were in 
the program the previous year and who were re-tested a year later 
indicated that the students maintained and improved their grade-level 
scores. 

In a study conducted by Solomon (1973) a local career education 
* program was evaluated to measure the effect of the program on academic 
achievement and career development. Forty fifth- and sixth-grade 
experiiTicintal group students were compared with forty fifth- and sixth- 
grade matched controls from another school. The Mathematics and 
Reading tests of the Metropolitian Achievement Tests were two of the 
posttests administered. No significant differences were obtained on 
any measure f indicating that occupational and self -awareness did not 
impede growth in scholastic areas. 

In a study involving 348 elementary students in North Central 
TexaSf Bryant (1975) found that academic achievement was increased 
through the implementation of career education program. Randomly- 
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selected schools in a ten-county area participated in the study 
which was part of a largjBr dissemination effort jointly sponsored 
by Education Service Center Region XI and Partners in Career Educa- 
tion. Seventeen fifth-grade classes in five school systems partici- 
pated. Within the three larger school systems r both experimental 
and control classes were identified. Classes in the two smaller 
school systems were matched with control classes in other school 
districts. 

Teachers in the experimental group participated in three days 
of staff development and were given teacher-developed career-education 
curriculum ^guides for use in planning instruction in language arts 
and social studies classes. Consultant help was provided teachers 
on a request basis. 

Forms Q and R of the Comprehensive Tests of Basic Skills were 
administered as pretests and posttests in October and February of 
the 1974-75 school year. Adjusted means were used in the analysis 
of the data; analysis of covariance was the basic statistical pro- 
cedure employed. Statistically significant differences between the 
two groups were found to exist on the scores of the total achievement 
battery (p < .001) , Reading Test (p <. 01) , Language Test (p < .00) ^ 
and Study Skills Test (p v^.Ol). Differences that were statistically 
significant at the .001 L^veJ (p <.001) were indicated in the 
Vocabulary f Language Expression, and Reference Skills subtests. All 
differences favored the experimental group. 
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Career-education concepts were not introduced into the arithmetic 
curriculum, and no greater gain was niade in arithmetic by the experi-* 
mental group than was made by the con\^xol group. The findings supported 
the conclusion that the infusion of career-education concepts into 
the ongoing program of curricular offerings can have a positive effect 
upon the cognitive growth of students as evidenced by achievement 
test scores. 

A three-year occupational information project for grades 1-12 
was implemented in the schools of Henderson County, Kentucky. The 
Comprehensive Test of Basic Skills was used along with the Barclay 
Classroom Climate Inventory and other instruments to assess the 
value of the program. No negative effects on students' scholastic 
growth was reported. It was concluded by the researchers that the 
school had changed from a traditional subject matter orientation to 
a more life-centered one. 

In a manuscript e?ntitled,. "Evaluation of Career Education: 
Implications for Instruction at the Elementary School Level," 
Hoyt (1975) referred to results reported by Clifton Purcell of the 
Santa Barbara, California, career education program in 1974. The 
Cooperative Primary Reading Test was administered to second grade 
students in a class in which career education approaches were 
emphasized and in a class not involved in such an approach. The 
scores for the students in the career-education-oriented class were 
significantly higher, statistically, than the scores of the other 
students tested. Mr. Purcell is no longer with the school district 
and a copy of the study was not made available. 
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Director James Spengler of the Board of Cooperative Education 
Services (BOCESr District One, New York) (1975) provided information 
regarding the preparation and field testing of curricultjm materials 
designed to infuse the career education concept into the normal 
academic curriculum. The development of the Career Education 
Instructional System is part of the effort of the New York State 
Consortium for Career Education. 

The first year of the project was one of planning and develop-' 
ment during which twenty-one school districts in Erir- BOCES #1 and 
#2 participated. One hundred teachers, counselors, administrators 
and media specialists were oriented and trained to px'-epare curriculum 
packages in language arts, math, science and social science at all 
grade levels. Fifty-two Learning Activity packets, including 900 
Learning Activity sheets were prepared, evaluated by experts, revised 
and printed. 

Following summer orientation, three hundred teachers used the 
packets in their classrooms* Teachers' evaluation indicated high 
student interest during activities in which the infusion technique 
was used. An examination of pre- and post^achievement testing indicated 
slight gains in the twenty-eight test cells (grade level — subject) for 
which data were obtained. Two cases were statistically significant 
in achievement gains during the first year of field testing. 

During the 1974*-75 school year, the reported high interest of 
students using the packets was verified by independent survey of 
students. Examination of pre- and post-assessment indicated increases 
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in achievement again in all but five of the sixty-four test cells. 
In sixteen cases the gains , experimental over control , were statis- 
tically significant. , Improvements were shown in cells representing 
223 students in fifty-nine classes r or twenty-six of the classes. 

Included in a career education program in Elhartf Indiana were 
eighth and ninth-grade students in an inner-city school. Objectives 
were to enable the students to increase their reading and compre- 
hension levels and to increase their career options. Participants 
in the program were functioning at reading levels four or more years 
below their grade level. Directed activities utilizing workbooks were 
provided the student for one period per day. Fourteen learning 
excursions into the community were made by the group during the year. 

Scores of students indicated growth gains in language and 
reading skills that ranged from .6 to 3.3 years. The average gain 
was 1. 5 years . 

The three-year developmental career education progrcim in Cobb 
County, Georgiar was 'reported by Smith (1973). The project's efforts 
produced a broad-~basedr developmental, sequential curriculum within 
elementary, middle and secondary schools. The project by design and 
by nature placed special emphasis on these students who were culturally, 
economically or otherwise handicapped or disadvantaged. 

An objective of the program was to integrate a career development 
program into existing curriculum to enhance traditional academic 
learning. A product objective to increase student academic achievement 
as measured by achievement tests was partially attained. The 
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evaluation was based upon results of the regular school administra- 
tion of Iowa Tests of Basic Skills to third-, fourth-, and sixth-grade 
students in September, 1972. At the third-grade level, the average 
grade equivalent score for experimental and control students was 
3.35 (comparison mado to grade equivalent of 3.1). 

The fourth-grac students were tested in October, 1972, and 
the expected grade equivalent score was 4.2. The overall mean 
score for the ?roj. t schools was 4.15; the average score in the 
control schools w ... J. 95. 

The overall grade equivalent scores of sixth-grade students 
in the project schools exceeded the expected grade equivalent 
score by .2 while the score in the control schools was .2 less than 
the expected grade equivalent. The overall means for the project 
schools were equal to or higher than the overall means of the control 
schools at each of the three grade levels tested. 

One of the goals of the Cobb County program was to create 
opportunities for the student to utilize the subject matter in 
manipulative learning situations. Another goal was to provide 
cipportunities for the student to observe the practical application 
of academic subject matter in the work community. 

From a first-year project involving twenty-four teachers in 
four elementary schools, the program was expanded to include forty- 
eight teachers the second year. In a "teacher-helping-teachers" 
approach, thirty-four Cobb County schools were eventually included 
by the third year." 
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This project demonstrated the feasibility of a transportable 
career education program that involved little expense and was main- 
tained as an integral part of the educational experiences of all 
pupils at no extra cost. One evaluation that was meaningful to 
the local planners was "^^ie ti.ot that the school board voted for 
expansion of the program to all schools* 

Math sections of pretests and posttests administered to 
selected third- and fourth-grade students in Calhoun County, Michigan, 
(Simpson, 1974) incorporated various math functions such as multiplica- 
tion, addition (shaded figures), angles, fr'iCtions, points and lines, 
notations, and division. Both the experimental and the control groups 
showed little or no change on the multiplication section, which 
apparently was too difficult. For the remainder of the items in the 
math section of the test, the two groups scored about tJ^e same, 
supporting the hypothesis that academic competence (as measured by 
a math test) would not be impeded as a result of the implemented 
career education program. 

Following the rationale that career education is for everyone, 
different schools hav<i>. provided programs for slow learners, potential 
dropouts, disadvantaged students, and accelerated learners. In the 
licKeesport Area School District of Pennsylvania, (1974) pretests and 
posttests were administered to elementaary students in the academically 
talented program. Of the eighteen units attempted, fifteen showed 
statistically significant student improvement between pretests and 
posttests. "Several of the improvement rates were quite startling 
with a 1706 percent improvement being observed in the Minerals and 
Gems unit and 1250 percent growth rioted in the Forestry unit." 
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(McKeesport, p. 26). The program for the academically talented was 

highly successful. 

Selected elementary students in regular classes in the McKeesport 
District were also tested in rega: d to eleven career education units. 
Those children engaged in Anthropology, Senses and Agriculture units 
showed statistically significant improvement. The other units, while 
failing to reach the statistically significant level, showed general 
improvement. 

In Philadelphia a prototype experienced-based career education 
program has been developed, operationalized and tested by Research 
for Better Schools, Inc. The four years of the career education 
program have encompassed one year at che planning .itage and three 
additional years at the operational stage. According to Kershner 
and Blair (1975) the evaluation activities during the first year 
of operations were largely formative in nature. Data were collected 
on the extent of implementation, perceptions of participants, and 
student progress on several criterion measures. No comparison groups 
were available to establish external standards or determine effects 
of the program. 

During the 1973-1974 school year, 250 students were released by 
the School District of Philadelphia to participate in the program. 
The report of the interval evaluation staff focused on the 38 first- 
year students who completed all of the testing. Data given for another 
group of 54 students is not reviewed here because no comparison group 
was available. 
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The Experienced-Based Career program included three types of 
instructional activities. First/ students spent at least one day 
a v;eek engaging in wide variety of "hands-on" activities conducted 
at the work sites of over eighty participating industries r businesses 
agencies and unions. Second , structured small group guidance sessions 
were held each week in addition to individual counseling thaf was 
provided. For an hour and a half each day students were given indivi- 
dualized learning opportunities in communication skills and mathema- 
tics. A teacher-student ratio, of 18. 44 to 1 was reported. 

All students were administered a pretest-posttest series of 
instruments which included the Comprehensive Tests of Basic Skills. 
Levels and Forms of the tests used were not specified in the material 
reviewed. Hypothesized growth within groups was tested through the 
use of correlated t- tests. In all studies reported herein except 
those relating to evaluation of Experience-Based Career Education 
projects r a . 05 of .01 level was established as a level of signifi- 
cance . 

All of the tests run on the experimental group demonstrated a 
statistically significant (p <C.10) growth in reading and math. 
In addition to a total reading and arithmetic scores f scores were 
obtained on vocabulary , comprehension , computation concepts, and 
applications. 

Analysis of covariance revealed no statistically significant 
differences between the gains of the experimental comparison students 
except for a difference f favoring the experimental group , in 
Arithmetic Application. 
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Highly positive attitudes toward the program were reflected 
by students, parents and employers. The experimental students 
gained significantly in career maturity and attitude toward school. 

Indications were that useful data should result from the 
evaluation of the 1974-1975 program because a true experimental 
design was implemented and, for the first time, students were 
randomly assigned to treatment and non- treatment groups. Data 
were not available in early October, 1975. 

Northwest Regional Educational Laboratory made an evaluation 
of students in another Experience-Based Career Education program. 
Using the subtests of the Comprehensive Test of Basic Skills, as 
pretests and post tests, evaluation was made in tlie areas of reading 
and math. A statistically significant gain in reading was shown 
by students in the experimental group; the gain was not statistically 
different from that shown by the comparison group. On a newspaper- 
reading exercise designed to assess the applied reading skills of a 
sample of students, statistically significant growth over the year 
was demonstrated. 

Individual study, individual tutoring, and application of skills 
in practical situations were all employed to help students increase 
their ability in mathematics. Scores on the math subtest, of the CTBS 
showed that students in the experimental group made a statistically 
significant increase in their scores in this area. EBCE students on 
the average increased their grade equivalent scores .7 years. This 
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compares to a decredee of .1 grade equivalent shown by the comparison 
group . 

Through the administration of the Iowa Tests of Educational 
Development on a pretest-posttest basis the Far West Laboratory 
sought to determine the effects of an Experience-^Based Career 
Education^^rogram on thirty-^six students at the tenth- , eleventh-! 
and twelfth-" grade levels. The tests were given to students in 
the experimental and to control groups and comparison groups from 
the Oakland Public Schools during November and May of the 1973-1974 
school year. Grade-score equivalents were used in the analysis of 
the data. 

Analysis of covariance of the math and reading scores for the 
two groups indicated that, even, though the experiiRental group had a 
greater average change on the math test than did the control group r 
the difference was not significant. On the reading test, the regres- 
sions of the May scores on the November scores were significantly 
different at the .10 level. Thus, there was no accurate test of 
the significance of the difference in means. 

A positive change in writing skills was observed by more 
students in the experimental group (38%) than in the control group 
(14%). Writing samples were collected fiom the experimental group 
at the beginning; samples were not availaible from a control group. 
Writings of the Far West School students were collected at the end 
of the school year and judged with respect to three characteristics: 
mechanics of writing, effectiveness of communication, and maturity 
or logical though tfulness. Potar experienced test readers refined 
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the draft definitions of each of the three characteristics and 
described a five-point scale in each area. For purposes of estimating 
the reliability of the ratings assigned for a given characteristic, 
there were eight ratings for a particular student (four raters for 
pretest scores and four for posttest scores) . This yielded six 
interrated correlation co-efficients for the pretest and six for 
the posttest. The Spearman-Brown Propheci' Formula was applied to 
the median correlation co-efficients. The estimated reader reliability 
of the average ratings for each student on the Mechanics and Effective- 
ness scores were quite high. The reliability of the Thoughtf ulness 
score was not high, but the score was used because no data were 
available for a better measure on the important characteristic. 

The distribution of the differences in individual scores on 
the pretests and posttests showed that the percent of students whose 
written communication scores increased by more than one standard error 
of the difference was much higher than would be expacted (16%) if 
there had been no increase for the group as a whole. Approximately 
55% of the students showed a significant increase in Me^»>anics and 
Effectiveness, and none of them showed a significant loss in these 
skills. Two students showed a significant loss in Thoughtf ulness 
and 41% showed a significant increase. 

In summary, a large proportion of Far West School stiidsnts 
showed increases in their writing skills that were both statistically 
and educationally significant. This was the only study reviewed 
that included an evaluation of students' compositions. 
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In a final evaluation report on Experience-Based Career Education, 
Appalachia Educational Laboratory reported that the ninety-'two EBCE 
students did as well as the comparison groups on scholastic growth. 
Data sources included the subscores on Educational Development Series 
(EDS) and Iowa Test of Educational Development (ITED) . All of the 
students were given EDS during the fall of their eleventh-grade year 
and the complete battery of the ITED upon entry into the EBCE program 
and again in April. Comparison groups were not given the ITED. 

A multivariate analysis of variance was used to compare the EDS 
pretest mean scores on the six subtests over the three groups of 
students (EBCE, Coop and randomly chosen). The resulting F value 
was found to be significant at the .05 level (p < .05). 

A visit to the offices of Development Associates and perusal 
of An Evaluation of Vocational Exemplary Projects did not produce 
data pertinent to the specifications of this paper. The evaluation 
report did contain the evaluators' "commendations of the United States 
Office of Education and especially the program staff of the Department 
of Vocational Technical Education for actions taken to improve both 
the content and the management of federally-funded progrcims. Some 
of the evaluations reviewed in this paper are of programs conducted 
during the 1973-1975 school years under the revised management 
procedures. 
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CONCLUDING STATEMENTS 

In his analysis of the lifelong process of vocational 
development, Havighurst (1964) has identified the second stage 
as "Acquiring the Basic Habits of Industry." Learning to 
organize one's time and energy to get a piece of work done 
(school work, chores) and learning to put work ahead of play 
in appropriate situations are aspects of the stage. Assuming 
that good work habits are possibly correlated with academic 
success in today's schools, attention is called to data 
produced in the McKeesport, Pennsylvania Schools. 

An indicator of student success in the career education 
program there was the shift in type of student activity. 
Time devoted to planning activities increased 14% (p < .05) 
and 16% (p < .01) more time was spent by students in iii5>lemen- 
tation. Although 8% more time was spent in evaluation, the 
increase was not significant. Statistically significant 
(p ^ .01) was the reduction by 38% in the amount of time spent 
in non-productive activities . The categorization of the 
students' behavior was based on Time series sampling by 
multiple observers not involved in the treatment. Additional 
emphasis upon problem-solving and critical-thinking abilities 
was given through the career education program. 

Assessment of many programs included information concerning 
the improved self concept or self esteem of students. The 
final report of the research and development career edacation 
project in Raleigh, West Virginia (1974) cited relationships 
among self concept, ability and achievement. Results of the 
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study showed that for seventy-two students at the third-grade 
level/ self concept (as aneasured by the Self Observation Scales) 
accounted for 13.5% of the variance in predicting ability and 
21.2% of the variance in predicting achievement (as measured by 
the Education Development Series test battery) . These findings 
were consistent with the research data of IBEX, Inc., which 
indicates that self concept is a major contributor to achievement 
and is a construct distinct from ability (Klaus, 1974). 

Seventy-seven percent (77%) of the teachers in the 
Sacramento Unified School District indicated that career 
education greatly increased pupil motivation for class work. 
Sixty-three percent (63%) said that pupils were more interested 
in school projects as a result of career education. Similar 
support was given by teachers in Richmond, California, as well 
as in many other locations • 

If students have good feelings about themselves and positive 
relationships with others, school achievement may increase. 
Hoyt (1975) points out that positive relationships have been 
established between productivity and reduction of worker 
alienation. He maintains that educational productivity — 
increases in academic achievement — should result if worker 
alienation is reduced among students and teachers. Many of 
the techniques and strategies of implementing career education 
progreuns are aimed at reducing worker alienation among students 
and teachers. 

Evaluations of a number of school-based career education 
programs reflect satisfaction of students, parents, educators. 
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and other community members with the goals, activities and 
results of the implemented programs. Continued support of 
the exemplary projects, expansion of pilot-school programs 
to encompass entire school systems or countrywide units, and 
records of community involvement are described in reports. 
These "soft data" and numerous other supporting materials 
appear to reflect the information needs of many educators 
at the local level. Reading the wording of program goals 
and objectives, one might infer that local planners concurred 
on a basic assumption that academic achievement would not be 
impeded by making the curriculum more relevant to the world o2 
work and emphasizing the career development and guidance of 
children and youth. 

Communication of goals and objectives or programs to 
educators at various levels is essential to evaluation. The 
Union county. North Carolina (1975) study included a recom- 
mendation that teachers be encouraged to devise activities with 
specific objectives in mind for their instructional units and 
lesson plans. The failure of the middle school students to 
outscore the control students "indicates that the objectives 
as understood by the evaluators are not consistent with those 
of the lab teachers." 

Parties involved in programs do not always communicate 
among themselves their separate criteria for acceptable 
evaluative data. Different levels of evidence of the efficacy 
of career education are acceptable to people functioning in 
various educational roles. Information considered to be most 
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useful is not always that which is rigorously obtained. Support 
to the two foregoing statements is given by examination of the 
variety of materials sent in response to requests for hard data 
to be reviewed for this paper. The materials are listed in the 
bibliography , 

Commissioner Bell (1974) has stressed the importance of 
maintaining the grass-roots-level initiative for career education. 
An aid in balancing federal and local support may be the develop- 
ment of innovative evaluative procedures that can result in 
assessment information needed at state and national levels as 
well as in data that is useful at the local level. 

Although this paper does not represent an exhaustive review 
of evaluations conducted, it does, to the greatest extent possible, 
contain reviews of studies currently available. Indications are 
that the evaluations of many 1975-1976 programs may contribute 
substantially to the knowledge now available concerning the 
interrelationship of career education and academic achievement. 
Soft data have indicated that positive changes in the self 
concepts and work habits of some students have taken place. 
Follow-up studies p indeed, may net more hard data that career 
education can aid the development of students' acquisition oi 
the fundamental skills — reading, writing, and arithmetic. 



65 



ERIC 



BIBLIOGRAPHY 



Agnello, Leslie, "Careers Related to Basic Mathematics, 

Richmond Unified School District, Richmond, California, 
1974. 

Appalachia Educational Laboratory, Inc., Final Evaluati on 

Report, Research and Development Project in Experience 
Bisid~Career Education , Charleston, West Virginia, 1974. 

Bardstown Independent School, Model Demonstration Project 
Evaluation Report , Bardstown, Kentucky, 19/5. 

Behavioral Research Associates, Careers, career Awareness , and 
Readiness , an Educational Evaluation Tlesearch Survey, 
Tucson, Arizona, 1975. 

Behavioral Research Associates, Cochise County Career Education 
Project , Evaluation Report , 1974-75 , Tucson, Arizona, 1975. 

Behavioral Research Associates, Summary Evaluation Report of 
Career E ducation on Southern Arizona, Arizona State 
Department of Education, Tucson, Arizona, 1974- 

Bell. T. H. , Career Educ ation in 1974 ; A View from the 

C ommissi^^^iP7 DiikTr^pared for the National Conference 
for State Coordinators of Career Education, Center for. 
Vocational Education, The Ohio State University, 
October 31, 1974. 

Bottoms, Gene, Career Development Education K Throug h P2St- ^ 
Secondary and Adult Education , Georgia State Department 
of Education, 1972, ED 062-580. 

Bryant, Rita Storie, M Experimental Study of the Effect gf 
a Career Education Program on Academic Achievement and 
Attitudes of Fifth-Grade Students . Unpublished doctoral 
dissertation, North Texas State University, 1975. 

Budke, Wesley Eugene, Review and Synthesis of Information og 

oc cupational Exploration , Ohio State Center for Vocational 
and Technical Education, 1971, ED 056 165. 

Calhoun intermediate School District, Career- Oriented Cur riculum 
Project Final Evaluation Report , Phase III , 
Marshall, Michigan, 197 4. 

Carlson, Richard E. . Building a Psychological Career Awareness 
Model: A Field Study to Evaluate tiie Effectiveness of 
AShiivemenFM^tivation Simulc^tion on Career Development, 
District of Columbia Public Schools, Washington, D.C. , 19.2, 



67 

66 



Central Columbia Area School District, Central Susquehanna 
Interiaediate Unit, Career Development Guide, Field 
Testing Program, Lewisburg, Pennsylvania, 1S75. 

Ceres Unified School District, Preliminary Evaluation Report . 
Elementary Sectio n- C areer Education Response to E^ery 
Student , Ceres, California, 1975. 7" 

Connecticut State Department of Education, C areer Education 
in the Norwalk Public Schools, Exemplary Project , Final 
Report , Hartford, Connecticut, 1975. 

Dallas Independent School District, Career Education Concepts : 
A Statement of the Dallas Independent District , Conceptual 
Framework for Career Education Developdtient , Dallas, Texas* 
1973. 

Datta, Lois--ellin, "Progress in Evaluating Career Education," 
National Institute of Education (DHEW) , Washington, D.C. 
(presentation to the Career Education National Form, 
Center for Vocational Education, Ohio State University, 
March 19-21, 1975) - 

Development Associates, Inc. , Evaluation of Vocational Projects , 
Part D , Vocational Education Act Amendments of 1968 , 
Washington, D.C, 1975. 

Dewey, John, Democracy and Education, New York^ The Macmillan 
Company, 1931. 

Downs , W. A. , In-Service Education Model for the Dissemination 
and Utilization of Selected Career Education Concepts 
Presentee by the Career Cluster Approach in the Elementary 
School , Jefferson City, Missouri, MissourlT^State Department 
of Education, 1974, ED 099 514. 

Educational Research and Development Associates, F inal Report 

Career Education Program , McKeesport Area School District , 
West Chester, Pennsylvania, 1974. 

Elkhart Career Center, What ' s In A Name? , Elkhart, Indiana, 
Elkhart Career Education, 1975. 

Evaluation Report for the Washington State Coordinating Council 
for Occupational Education Vocation Edtication D ivision - 
R esearch and Development Project in Career Education , 
Cashmere and Peshastin-Dryden School Districts, 
Washington, 1974. 

Far West Laboratory for Educational Research and Development, 

Experience - Based Career Education, Final Evaltiation Report^ 
Volume I and Volume 11, Washington, D.C, National Insti rate 
of Education, 1974. 

08 

67 



ERIC 



Gallup, George H., "Fourth Annual Gallup Poll of Public Attitudes 
Toward Education/' Phi Delta Kappan , LIV (September, 1972), 
35. 

Gibson, M. P. , Henderson County Vocational Education Curriculxim 
Integration Project:. History Report , July 1^ 1970 to 
June 30, 1973 , Frankfort, Kentucky, Kentucky State 
Department of Education, 1973, ED 087 910. 

Good, Carter U. , editor:,. Dictionary of Education, New York, 
McGraw-Hill Book Gtompany, 1973. 

Grossmont Union High ffiorhool District, A Study of Career Centers 
in the State of California , Final Report , La Mesa, 
California, 1975. 

Grossmont Union High School District, Master Plan for Career 
Guidance and Counseling , Final Repor t, Pupil Personnel 
Services, La Mesa, California, 1975* 

Harris, Louise, "The World of Work," Richmond Unified School 
District, Richmond, California, 1974. 

Havighurst, Robert J., "Youth in Exploration and Man Emergent," 
Man in a World at Work, edited by Henry Borow, Boston, 
Houghton Mifflin Company, 1964. 

Herr, Edwin L., and Stanley H. Cramer, Vocational Guidance and 
Career Development in the Schools ; Toward £ Systems 
Approach , Boston, Houghton Mifflin Company, 1972. 

Holden, H. D. , Exemplary Project in Career Education in South 

Carolina, Region V, Final Report , Washington, D.C., United 
States Office of Education, 1973, ED 086 820. 

Holloway, Richard E. , "Summary Report of a Study of Career 
Education Competencies Needed by Elementary and Junior 
High School Teachers in Selected Schools in Oregon," 
Oregon State Department of Education, Division of Career 
Education , Salem, Oregon , 1972 . 

Hoyt, Kenneth B. , An Introduction to Career Education: A Policy 
Paper of the U. S. Office of Education, Washington, D.C. , 
U. S. Office of Education (DHEW) , 1975. 

Hoyt, Kenneth B. , "Career Education and Career Choice," 
American Vocational Journal (March, 1972), 84-88. 

Hoyt, Kenneth B. , "Ca^treer* Education and the Teaching/Learning 
Process," Educational Leadership , XXXIII (October, 1975), 
31-33. 

69 



68 



Hoyt, Kenneth B. , "Evaluation of Career Education: Implications 
for Instruction at the Elementary School Level/" manuscript 
prepared for the Spring^ 1975, issue of the Journal of 
Career Education . 

IBEX/ Inc., "Annual Evaluation Report for the New Albany/Floyd 
County Schools, New Albany, Indiana, Career Resources 
Center, 1973-1974," Arlington, Virginia, 1974. 

Interim Report on Career Education Pilot Project K-14 , Allegheny 
Intermediate Unit, Pittsburg, Pennsylvania, 1975. 

Jacobsori, Thomas J. , K nowledge Needed to Obtain Work (KNOW) , A 

Programitied Package to Prepare Pupils for Placement, Ventura, 
California, Ventura Unified School District, 1973. 

Katz, Martin, Measurement for Self - Understanding and Personal 

Development , Proceedings of the 1973 Invitational Conference 
on Testing Problems, ?;ducatiional Testing Service, 1973. 

Kenai Public Schools, B>E.S>T. Program (Handicapped Students 
Becoming Employably Skilled and Trained) Evaluation , 
Kenai, Alaska, 1975. 

Kershner, Keith and Mark Blair, Summative Evaluation of the RBS 
Career Education Program , Philadelphia, Pennsylvania, 
Research for Better Schools, 1975, ED 104 952. 

King, Irv, and Harry Patterson, Lanakila Project Evaluation 
Report , Honolula, Hawaii, University of Hawaii, 1974. 

Klaus, Mary Louise/ Resecirch and Development Project in Career 

Educat ^.on . Final Report , Raleigh County Board of Education, 
Beckley, West Virginia, Charleston, West Virginia, West 
Virginia State Department of Education, ED 089 107. 

Lapinski, E. J. , Assessment Prccrram ; Stamford High School, Final 

Report , Stamford, Conn., Dept. of Education, 1972, ED 068 709. 

Lawrence Unified School District 497, Final Report , Lawrence, 
Kansas, 1973. 

Leighbody, G. B. , "Vocational Education Looks to the Future," 
Influences in Curriculum Change , edited by G. G. Qnruh 
and R. R. Leeper, Washington, D.C., Association for 
Supervision and Curriculuia Development, 1968. 

Lichtman, Erie .T. , "Ninth Grade English Reading Career Education 
Unit," Richmond Unified School District, Richmond, 
California , 1974. 

"Marland, on Career Education," American Sducation (November, 1971). 



70 



69 



Marland, Sidney P.. Jr., "A Report on the Condition of Education. 
Th4 Endless Renaissance," United States Department of Heal^, 
Education and Welfare, Washington, D.C. , Publication No. (OE) 
72-101, United States Government Printing Office, 1972. 

Marland, Sidney P., Jr., "Career Education Now," Washington, DC. , 
United States Office of Education (DHEW) , 1971, ED 048 480. 

Muscatine Community Schools, The Assessment of Care|r Awareness. 

and Career Exploration in Muscatine Community Schools, 1975 , 
Muscatine, Iowa, 1975. 

Nampa Public Schools , The World of Work , Application for 
Continuation, Nampa, Idaho, 1975. 

National Institute of Education, Career Education Program Plan 
for Fiscal Year 1975 , Washington, D.C. (DHEW) , 1974. 

National Institute of Education, The Community is the Teacher , 

Experience-Based Career Education , Washington, D.C. (DHEWJ , 
1975. 

Neal, William, Vocational Education in Knox ^g^ntii, Knoxville, 
Tennessee, Knox County Public Schools, 1972, ED 074 289. 

North Dakota State Department of Education, A Developmental 

Program , Pre -School -Adult , In Career Education for North 
Dakota, Bismarck, North Dakota, 1975. 

Northwest Regional Educational Laboratory, Final Evaluation 
Report of the NWREL Experience -Bas_ed Career Education 
Program , Portland, Oregon, 1974. 

O'Hara, Robert P., "A Theoretical Foundation for the Use of 
Occupational Information in Guidance," Personnel and 
Guidance Journal , XLVI (March, 1968), ED 636 640. 

Olson, LeVene A. , A Study -of Elementary and Secondary Ct^eer 
Education in Lincoln County , Department of Occupational 
and Adult Education, College of Education, Marshall 
University, Huntington, West Virginia, 1974. 

O'Reilly, Patrick A. , Predicting the Stability of Expressed 
Occupa tional Choices Secondary Students , Vocational- 
Technical Education Res'earch Report , Pennsylvania State 
Departmen t of Education, Bureai of Vocational, Technical 
and Continuing Education, Harrisburg, Pennsylvania, 1973, 
ED 078 228. 

Osipow, Samuel H. , "Implications for Career Education of Research 
and Theory on Career Development," prepared for the National 
conference on Career Education for Professors of Educational 
Administration, Colvmbus , Ohio, 1972. 

7i 



70 



Penasco Independent School District, Interim Report — Evaluation 
of a Career Education Program for a Small Rural School , 
Penasco, New Mexico, 1975. 

Pima County Developmental Career Guidance Project , Career Education 
Evaluation Report 1974-75 , Pima, Arizona, 1975. 

Ploughman, T. L. , Evaluation Report , Pontiac Vocational Career 
Development, Educational Services and Products, I^'O w 
Pontiac, Michigan, 1971. 

Raleigh County Schools , Assessment of Career Education Project , 
Raleigh, West Virginia, 1973. 

Richmond Unified School District, Project Activity Management and 
Evaluation System for Career Education Program , Richmond, 
California, 1973. 

Sacramento City Unified School District, Career Education A 

Resource for Elementary Teachers , Sacramento, California, 
1974. 

Safransky, Robert J., "New Skins for New Wine," paper presented 
at Annual Convention of the National Association of 
Secondary School Principals, Dallas, Texas, February 5, 1973. 

Sidney Public Schools, End of Year Report , Project HELP , 
Sidney, Nebraska, 197 S. 

Simpson, A. L. , An Assessment of the Effects of Integrated 
Curriculum on Students in Calhoun County 1973-1974 , 
Mason, Michigan, 1974. 

Smith, Joel, A Developmental Program of Occupational Education 
Final Report , Cobb County Board of Education, Marietta, 
Georgia, 1973. 

Solomon, S. , Career Education and Its Impact on Academic 

Achievement and Career Development . ' Unpublished doctoral 
dissertation. West Virginia University, 1973. 

South San Francisco Unified School District, End of Year Report , 
Sequential Career Education Project , San Francisco, 
California, 1975. 

.Spengler, James, Career Education Instruct i onal System Three 

Year Project Summary , Board of Cooperative Education Services, 
First Supervisory District, Erie County, Harness Occupational 
Center, Cheektowaga, New York, 1975. 

Springfield Public Schools, Comprehensive Career Education 
Process in Springfield Public Schools, Interim Report, 
Springfield, Oregon, 1975. 

72 



71 



Spring Valley School District, Career Education in. Action , 
La Mesa, California. 

Struck; John W. , and Carroll A. Curtis ^ ^H^.^gE^; ^fg^f^^^ 
aAd Development Project on Career Education, Harrisburg, 
Pennsylvania, Department of Education, 1974. 

Tadlock Associates, Inc. , Summary Report on the Internal 

Ev aluation and Consulting Services for the Orange Coung 
Consortium ciFeer Education Model (Third Year ) , Los Altos , 
California, 1975. 

Texas Association for Supervision and Curriculum Development, 
School Curriculum Design for the 1980's , Austin , Texas , 
Governor's Office of Educational Research and Planning, 
1974. 

Tuckman, Bruce W. , and Joseph A. Carducci, Evaluating Career 
Edu cation : A Review and Model , Report No. 36, National 
Institute of~Education (DHEW) , Washington, D.C. , iy/4, 
ED 102 212. 

Unified School District No. 250, A Consortium Approach ^ 

Exemplary Career Education Program Development Involving 
'Pwn gnif i g Tlchoor iDl^tiT^ts and Two Teacher Education 
iTT^titutio ns, An Evaluation Report , Pittsburg , Kansas 
1975. 

union county Schools, Career Based Curricalum. Prgjec^, First 
Year Interim Report , Monroe, North Carolina, 1975. 

United States Office of Education (DHEW) , The Office of. Career 
Education, Career Education Programs and Progress • • • ^ 
Report on U. S. "office of Education Activities, in Career 
Educati^K in Fiscal Year 1973 , Washington, D.C. , iy/4. 

United States Office of Education (DHEW) , The Off ice of Career 
Education, Career Education: The State of the Scene , 
Washington, D.C, 1974. 

United States Office of Education (DHEW), Handbook for the 
Evaluation of Career Education Programs, Bureau of 
Occupationar"and Adult Education, Washington, D.C., J.y/4. 

United States Office of Education (DHEW) , TaxononQr and Pr^ 

of Career Education , Volume I-IV, Education Division/Office 
of Education, Washington, D.C, 1974. 

upper Marlboro, Maryland, Department of Career Education, 
Prince George's County Public Schools, Does Career 
Education Work? , A Case Study on Prince George s 
County, Maryland, 1975. 



73 

72 



Whiter Peter E. , and Edward Revello, Presenting a Planned Program 
of Career Information to Elementary School Children . 
Unpublished doctoral dissertation. Research Coordinating 
Unitf Bxareau of Vocational Education, State Department of 
Educational and Cultural Services , Augusta, Maine, 1973. 

Wichita Public Schools, Research and Development Project in 
Career Education, Evaluation Report Summaries , Wichita, 
Kansas, 1975. 



74 

73 



ERIC 



THE EFFICaCy OF (3^REEK EDlXafPICN: • 
CAREER DEdSICN-rMOKG 



by 

Ki-chael J. Masiaoci 



75 

75 



Introduction 

The purpose of the paper was to examine and report attempts to evaluate 
pupil behavior sought by career education efforts in career-making. In so 
far as was possible, the paper concentrated ati-.^nticn at progremis designed 
to operate at the secondary school level. The ^/ap^^r was further delimited 
by a Statement of Work issued by the Office of Gainer Education. The 
statement included 1. review literature which is available within the 
Office of Career Education cuid other career education agencies, 2. gather 
input from State Co-ordinators of career education in the 50 states and 
from local practitioners of career education, 3- emphasize, to the greatest 
extent possible, that the data reported represent application of a particular 
cind well defined treatment. 

In addition, otifer concerns resulted from various discussions within 
the Office of Career Education, the National Institute for Education and 
some of the career education program 'unding agencies. These concerns were 
focused on the need for discussion concerning the nature of career decision- 
makingj the difficulties connected with its assessment and the process of 
determining outcome data which would suffice as evidence of career decision- 
msdcing "effects" . 
Framework for Career Education 

Kenneth Hoyt (1974) offers the following framework for career education: 

As a process, career education follows the model of 
career development. This model envisions a sequence in- 
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volving, in a progressive manner, (a) career aware- 
ness; (b) career exploration? (c) career motivation; 
(d) career decision-making; (e) career preparation; 
(f) career entry; and (g) career maintenance and 
progression. 

Further on in the same paper, he describes career .decision-making as 
follows: 

Career decision-making seeks to help the individ- 
ual answer three questions: (a) what is important 
to me; (b) what is possible for me; (c) what is 
probable for me? 

Wise, Chamer and Randour (1975) have identified two processes in 
career decision-making. 

Identifying opportunity : the process of perceiving 
and structuring career options. 

Assessing opportunity ; the process of identifying 
the benefits and costs associated with each in a set 
of options. 

They further state 

These two decision-making processes can be activated 
at any point in an individual's career and as society 
becomes more complex and as the market place creates 
new occupations and discards old ones, situations of 
choice will appear more frequently. 

These statements do not contradict the previous remarks by Kenneth Hoyt, 
but do encourage speculation that career decision-making may not be a pro- 
gressive stage, but rather a recurring event. The remarks also allude to 
a model of career education that will become progressively more open ended 
as societal complexity increases. 

For discussion purposes, it is possible to consider career decision- 
making as a process of identifying or assessing opportunity and as actual 
choices such as 1. entering a specific job or career, 2. increasing one's 
level of aspiration, and 3. choosing a specific occupational or ed^^- i^.ional 
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preparation program. These certainly do not exhaust the possitilities, 
but should provide a sense of the direction of the search encompassing 
this paper. It is these and similar events that were sought for in the 
materials examined. 
Theoretical Assumptions 

It was obvious, during the examination of materials, that theoretical 
bases for the various programs and projects differed significantly. It 
became increasingly apparent that it would be difficult to assess the pro- " 
grams from a single or unifying point of view since the very nature of these 
programs included the regional differences and specific approaches intended 
to solve a variety of highly localized problems and issues. Hone the less, 
some discussion of the theoretical basis lor career decision-making is in 
order. 

Waldemar Unruh (1974) describes a study of career decision-making 
conducted by the American Institutes for Research which was sponsored by 
the National Institute for Education. Included in this comprehensive treat- 
ment on decision-making are a Social Learning Theory of Career Decision- 
Making by John Krumboltz; an analysis of related literature by Anita Mitchell 
and a somewhat comprehensive discussion of program .interventions. Also 
included in the document are extensive lists of reference materials and 
reconmendations for directions in theory development as well as program 
development . 

The following propositions were cited in a chapter entitled "A Social 
Learning Theory of^CDM" by John Krumboltz which was included in the same 
report i 

Under positive influences, (on CDM) 

lAl. An individual is more likely to express a prefer- 
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ence for a course of study, an occupation, or the tasks 
and consequences of a field of work if that individual 
has heen positively reinforced for engaging in activities 
she/he has learned are associated with the successful 
performance of that course, occupation or field of work. 

IA2. An individual is more likely to express a preference 
for a course of study, an occupation, or the tasks and 
consequences of a field of work if that individual has 
observed a valued model heing reinforced for engaging in 
activities she/he has learned are associated with the 
successful performance of that course, occupation or 
field of work. 

IA3. An individual is more likely to express a preference 
for a course of study, an occupation, or the tasks and 
consequences of a field of work if that individual has heen 
consistently positively reinforced hy a valued' person who 
models smd/or advocates engaging in that course, occupation 
or field of work. 

IA4. An individual is more likely to express a preference 
in a course of study, an occupation, or the tasks and 
consequences in a field of work if that individual has heen 
exposed to positive words and images associated with that 
course, occupation or field of work. 

Under negative influences, four propositions yielding negative results 
are indicated 

IBl. ... if that individual has been punished or not 
reinforced, etc. 

IB2. ... if that individual has observed a model 
receive punishrrient or little or no reward, '^tc. 

IB3. .... if that individual has been consistently 
positively reinforced by a valued person who expresses 
negative opinions about the activities of persons, etc. 

IB4. ... if that individual has been exposed to 
negative words and images associated with that course, 
occupation or field of work. 

Similar propositions wore formulated regarding CM Skills and Entry Behaviors 

into Educational or Occupational Alternatives. 

In a subsequent chapter, Anita Mitchell ejialyzed and synthesized CJM 
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literature as related to the theory and since the findings were documented 
in her chapter, the following list represents some of the findings in her 
review. 

More college students raised than lowered. their degree 
of aspirations in junior college. 

Large percentages of students chemged goals while 
in college. 

Project TALENT data indicate that there was little 
stability of choice during five years after college. 

Project TALENT data from 1960-70 showed an increase 
in realism of career choices of high school boys. 

Amount of formal training in an area positively 
affected the airtount of information acquired in the 
area. 

Host differences found in patterns of information 
reflected differences in ir.terests. 

Students expressed need for help in career decisions. 

Some other findings in support of specific propositions follow; 

Favorite teachers appeared to influence choice of 
major except for Physical Education. 

Kore women preparing for non-traditional than for 
traditional careers stated that significant men in 
their lives believed women could perform-in these 
areas without jeopardizing niarriage or family. 

Students tended to increase their educational 
expectations by a fraction of a year as a result 
of counseling. Parental encouragement was also 
a factor. 

Nunierous other findings in support of the propositions were cited 
suggesting the viability of the theoretical approach as a potential experi- 
mental influence in CLM program development and research. The more obvious 

« 

and present value is that these chapters helped provide a perspective for 
exandning the project materials. 
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Materials Collection 

As previously stated, the statement of work (Appendix A) dictated the 
procedures to be followed, atnd after an initial search in the Office of 
Career Education and the National Institute for Education, a letter (Appendix 
B) requesting relevant information was mailed to the fifty state co-or-'LU^ators 
of career education. Over thirty state co-ordinators responded yielding 
approximately two hundred names and addresses of pro^ject directors of career 
education programs. Those states that did not respond were followed up with 
a second mailing of the initial request yielding several more responses. 

The next step was to send a letter (Appendix C) to project co-ordinators 
requesting specific data related to the scope of work and the purpose of 
the paper. These letters yielded information concerning approximately 120 
career education projects; several letters contending their progranis were 
not designed to yield data such as requested. Still another handful of 
letters indicated the discontinuity of funding and, therefore, no staff 
existed to assist in the study. 

The next step in the process was to generate an ERIC computer search 
on career decision-making literature (1975) event empirical studies 

had been conducted which might be linked to the project materials received 
from the project directors. This step, though highly xriformative and 
educational, was of no real value given the stated expectations in the 
scope of work. The significant assistance was frouk the NIE paper prepared 
by the AIR as previously mentioned. 

As previously stated,, each project co-ordinator (over two hundred) 
designated by the State Go-ord.irjLators of Career Education was asked to 
respond to specific inquiries concerning career decision-making, (see 
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Appendix C)« Less than one-third (approximately seventy) responded at 
all. Of those who did, none responded in a very specific way. More 
likely, they submitted the original program contract, a description of 
the project ana a copy of the general progran* evaluation report (if one 
existed). Thus, the potential for reviewing a large sample of project 
events diminished at a high rate. Some other factors that significantly 
reduced the number of reportable events are considered Delow. 

Kaiiy of the projects examined had stated specific program goals 
related to career decision-maicing at the elementary and middle school 
level, but since the scope of work called for secondary school projects, 
those projects were not included in this report. 

Several other pro^Tams had specific career decision-making objectives 
BD'A were primarily intended for secondary students, but either the treatment 
was so general that effects could not be traced to the program, or, the 
evaluation was not conducted, was incomplete ^ was in future plans. There- 
fore, those studies were not reviewed in this study. 

There were a few programs which intended to cover the career decision- 
making area in their projects at the secondary level and to examine the 
results in an appropriate wa,y, but lacic of time or funding prohibited 
their doing so. Those programs were not reviewed in this study. 
Review of Materials Received 

The following projects were selected for inclusion because they 
included 1. specific objectives in career education decision-naking 
.activities, 2. they had relatively well defined treatments to implement the 
objectives, 3. they used empirical methods of evaluating their results, 
althQi.:^h in some cases raw data were reported as results, (if the form 
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of these data could be analyzed statistic?.!! y, the raw data was reported 
and appropriately identified as suchr) T)re remaining materials which were 
judged to be within the scope of wirk -A'ere exaxrdned and reported. 
Review of Relevant Career Education H a cerla ls 

Pima County, Arizona. Developmental Career Guidance Profrrami Career- 
Decision-Making . 

The following information was contained in the "Summary Evaluation 
Report of Career Education" (I975). A career education media center was 
established at Apollo Junior High School. It was staffed by a career 
education specialist and was available to students as often as they wished 
to avail themselves of the service. Sixty-five percent of students in 
seventh, eigth and ninth grades (with heaviest users in the ninth grade) 
reported that the career center helped them decide on a future career* 
Seventy-five percent said the materials were useful concerning education 
requirements for various careers. In the same project, a t-test comparison 
of means for students having more exposure to career education with students 
having low exposure, yielded statistically significant differences (.001) 
in the high exposure group's greater ability "to recognize and demonstrate 
the decision-making skills associated \vith various occupational roles. 
Also, they were better able to recognize the degree of responsibility 
which is inherent in different jobs-** 
Cochise County; Arizona. Career Education Project . 

The following information was reported in a document entitled ••Cochise 
County Career Education Project** (1975) prepared by Behavioral Research 
Associates. A t-test comparison demonstrated that secondary students with 
high exposure to career education were more knowledgeable (statistically 
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significant at .001) about decision-making skills necessary than were 
secondary students with low exposure to career education. 
Grassmont Union High School District, La Mesa, California. 

Based on a comprehensive study of objectives and implementation centers 
in the state of California, Thomas J.. Jacobson (1975) ^^s reported signifi- 
cant ratios of increase on numerous career development objectives as 
students increase frequency of visits to career centers* Kore important, 
his research leads to the recommendation that teaching decision-making 
skills become an important priority for career centers. In his study, 
he points up the lack of useful curriculunj in the career decision-making 
area (and implies the lack of professional human resources in this area). 
These events indicate a need for funding programs to train experts in 
career decision-making curriculum development and specialists in the 
implementation of such materials. 
Georgia, Crisp County Education Prograirts . 

The following information was contained in a document entitled 
'Career Ed- ntion Projects" edited by Prank E. Welln^ (1974). The 
followr ^ objective was stated as part of the career education program 
in Crisp and Liberty Counties: 

The pupil will apply the decision-making process to 
a series of decisions and cononitments in the development 
of a career plan. 

Further, the process for evaluating the objective was stated as follows: 

The pupil will be able to defend his cluster selection 
with facts about himself, the cluster chosen, and his rea- 
son for his belief in the careers available in the cluster. 
The pupil will submit a plan to the teacher or counselor 
outlining his desired life style, and how he plans to 
reach this goal. 
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This goal was judged to have been fully achieved in the eleventh 
and twelfth grade in Crisp Couniy and the twelfth grade in Liberty County, 
but not in the eleventh grade in Liberty County. The judgements were based 
on a Survey of Education and Career Plans and on the Career Maturity Inven- 
tory results. 

Las Vegas, Nevada. Clark County School District . 

The information reported was from a document entitled "An Objective- 
Based Career Guidance Program" (1975) • an objective-based career 
guidance program (Profile Counseling) students were given "hands on" data 
about themselves from a computer-based information gathering system. The 
profile included grades, test scores, discipline indexes, career aspirations 
and educational aspirations. They received help interpreting the data from 
counselors, teachers, peers and parents. The Class of 1975 Which received 
the profiles was compared with the Class of 1974 who did not receive the 
profiles. T-ratios (significant at the .05 level) indicate that the Class 
of 1,9J5 felt better prepared to make intelligent decisions concerning future 
planning. , * 

Pleasantv'ille, New Jersey. Career Dev elopr.ent Program. 

The following information was contained in a document entitled "Suiraner 
Coupled Work/study Evaluation Results" (1975)* 

In a program entitled "Coupled Summer Work/Study," forty tenth and 
eleventh grade students were provided on-the-job training and work experience 
in various corjiiunity agencies for a r.ix-week period. These students were 
administered the Career Maturity Inventory in both pre and post test. The 
data presented demonstrates a significant improver.ent on all scalee but the 
atitiude scale (although statistical test of significance was rot reported). 
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CARFfjl KATURITY IMVENTORY 
(Sub Test Scores) 



Part 1 

Knowing Yourself 
Part 2 

Knowing About Jobs 
(Occupational Information) 

Part 3 

Choosing A Job 
(Goal Selection) 

Part 4 

Looking Ahead 
(Planning) 

Part 5 

What Should They Do? 
(Problem Solving) 

Attitude Scale 

Ilx.40 



Average 
Percentile 
Pre Post 

36 51 



57 71 

44 64 

56 76 

65 77 

55 50 



Mean 
Percentile 
Pre Post 

35 44 



53 



39 



82 



66 



Below 50th 
Percentile 
Pre Post 

31 19 



17 



24 



11 



53 83 



64 
59 



80 
42 



13 5 

9 2 

12 20 



Korth Central Vocational, Technical and Adult Education District, 
Wausau, Wisconsin. 

The following information was contained in a document entitled "Third 
Par-ftr Evaluation Report, of Career Education for Persont, in Rural Areas — Primary 
Focus on Adults 16 and Over," (1975). 

In a career education progreun for persons in rural areas wi+h a primar;y 
focus on adults 16 and over, a program was implemented that included the 
objective " to assist persons in self-evaluation and determination of career 
direction through testing, counseling and guidance . . . ." A summary of 
test results for the variable career planning knowledge yielded no signifi- 
cant difference between the treatment amd control groups for grades twelve. 
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Smnmary 

Most of the program materials reviewed for this study indicate a 
relatively informal approach to career education implementation as well 
as a relatively informal approach to evaluation of the programs. With 
this fact in mind, one can cautiously interpret the findings of the few 
studies cited, to indicate that it is possible to plan career education 
programs which include career decision-making objectives and to evaluate 
these in a relatively formal manner. Obviously, the great majority of 
prograiris (although most recognized the importance of career decision- 
nuking) elected to direct primary focus on awareness, achievement or 
other career education goals. Another important point to consider is 
the lack of longitudinal data to examine the nature . evolving process 
of career decision-making which must be undertaken if a hz r^r understanding 
of decision-making is to occur. 

Since the title of the paper included the word "efficacy'- which means 
either the power to produce effect or the production of iineridee. effects, 
one can generalize that career education programs have the pctea'iial power 
to produce career decision -making effects which are specific and desirable. 
It is also obvious that wide scale attempts at producing specific career 
decision-making "effects" has either not occurred and/or has not betr, reported 
extensively. Examination of all the material (ij.cluding that which was 
not included in the paper) indicate that much activiiy in career decisions 
making is included in the programs. . What aeems to be lacking is a sound 
theoretical-research base for pres-'-iMng and reporting these events. 
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APPETjDIX a 



statement of Work 

!• Contractor will meet with project officer in July, 1975 i in Washington, 
C«, to review literature which is available within the Office ox" 
Education and other career educatior agencies, 

2, Contractor will gather input from State Coordinators of Career 
Education in the 50 States and local practitioners of career 
education* 

3, The paper should emphasize, to the greatest extent possibl',^ that 
the data reported represent application of a particular ar^^d well- 
defined treatment. The paper will be written with the view that the 
primary audience will be local career education practitioners, 

4, The contractor will be required to submit an original and 25 copies 
of the paper to the Office of Career Education, U, S, Office of 
Education, no later than October I5, 1975 • 
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APPENDIX B 



TO: Each State's Co-ordinator of Career Education 

FROM: Kr. John Michel, Acting Director of the National Advisory Council 
for Career Education. 

The Council has recently contracted with four individuals to prepare a 
paper entitled, The Efficacy of Career Education . As a state co-ordinator 
of career education, you can direct these individuals to career educators 
in your state who have made systematic efforts to evaluate the impact of 
their programs. The Council is particularly interested in the evaluation 
methodolo{'-ies and m^easured results of programs whose objectives invalue: 

1) the development of career awareness 

2) the maintenance or improvement of academic achievement 

3) the development of career decision-making skills. 

Other program emphases such as career exploration, career preparation and 
job placement are also of interest to the Council in their effort to 
establish the full impact of the career education progran,s around the 
United States. 

In the space below, please enter the nairies of projects you feel should 
be included in the Council's study, and supply the contact information 
and program classification requested. Mail your list of projects in the 
enclosed self -addressed envelope. In order for your input to be considered 
in this study, it is important that your input be received no later than 
AUGUST 15. Thank you for your cooperation. 

PROGRAM OR PROJECT TITLE NAME, ADDRESS AND PHd^E AREA(S) EMPHASIZED IN 
AND FUNDING SOURCE OP CONTACT PERSON PROGRAM' 'S OBJECTIVES 
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APPQjDIX c 



i^ear Career Education Director/Coordinator: 

Your name/project was given to me by the coordinator of Career 
Education in your state in response to the attached l55tter from John 
Kichel, of HE^^. As the letter indicates, several of us have contracts 
to evaluate specific positions of those programs. 

Since ir^ contract area of interest is CAREER DECISIOM-KAKING SKILLS , 
I would appreciate any information you can send me which relates to 
Career Decision-Making Skills learned by participants in your program. 

More specifically, I need (iri addition, to a general description of 
the project): ' , 

1, a description of the objectives, , 

2. the treatment or means by whifh the objectives were met, 
3« the research design, ^ - 

4, the method of analysis, 

5« the results and evaluations related to the objectives, 

' ^ f' 

If by chance, yours- was not primarily a pro ject ^intended to improve 
Career Decision-Kaking Skills, I will appreciate a narrative statement 
of prograrri results in the area of Career Decision-Making, 

Since we are operating luider a. tight schedule, your prompt attention 
will be most welcome. Thank you for your assistance. 

Sincerely, 



Michael J • Masucci 
Chairman, Education Department 
Salisbury State College 
Salisbury, Maryland 2l80i 

Enclosure 
MJM:sph 
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THE EFFICACiT OF CAREER BDUCATION: 

V ■ 

OTHER VCVYS OF ASSESSING EFFECTIVENESS 



-by 

Cherylynn RLsch Schager 
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THE EFFICACY OF CAEEER EDUCATION: 
OTHER WAYS OF ASSESSHSG EFFECTIVETESS 



In addition to measiU7li3g students* career awareness, their academic 
achievement and their career decision-making skills, there are a number of 
other possible ways of assessing the effectiveness of career education. One 
such way is to examine the effects of self awareness programs which attem[pt 
to help students understand their own abilities; ^ interests and values. The 
success of occupationcLL preparation programs in teaching entry level job 
skills and the success of schools' job placement efforts are other ways worth 
investigating. Only after data pertaining to all these program components are 
collected and analyzed, will it be possible to pass judgment on comprehensive 
career education's^ success as a model for instructional programming. 

Since 1971^ the U.S. Office of Education, state boards of education and 
school district practitioners have worked hard to arrive at a common definition 
of the concept of career education. There is now considerably more under- 
standing of and agreement about what that concept is. There is also beginning 
to be more agreement about what comprehensive career education is in actual 
practice . The terms, career awareness, career exploration, career decision- 
making and the other caxeer development components have come to represent 
fairly uniform sets of activities to the career educator, regardless of his 
location. What still is unclear, however, is what constitutes an effective or 
a successful career education effort. 

What evidence an educator produces to attest to the success of a given 
educational program is generally a good indicator of the real goals s/he 
wanted to accomplish, regardless of what the written goals and objectives were 
that appear on the program's dissemination materials. In career education to 
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date, there seem to be at least tvo sets of goals, those vlx-ch describe 
anticipated student outcomes (products) and those vhich describe proposed 
program activities (processes). Current evaluation theory defines goals and 
obdectives as standards for measuring the effectiveness of a given program 
effort. Applying this definition to career education, the implication is that 
there are two vays to Judge the efficacy of career education: (l) "Program XYZ 
viU be considered a success if participating students demonstrate behaviors 
A, B and C," and (2) "Program XYZ will be considered successful if teachers, 
administrators and program staff do tasks A, E and C." These two sets of 
«tv.ndards are not in any way contradictory, but their simultaneous existence 
raises the question as to which set currently has priority in the minds of 
career education practitioners. 

Those career educators who produce evidence of their programs' positive 
effects on sttident attitudes, skills and knowledge appear to be classif^ng 
career education as an innovation in instractional programming. Those who 
point to cnanges in teachers' and administrators' attitudes toward career 
education and who call attention to the level of activity generated by their 
efforts seem to be placing it in the category of _ an educational reform movement . 
This dual image considerably complicates any study of the efficacy of career 
education by creating two competing definitions of what constitutes its success. 

While the major portion of this report concerns career education's 
efficacy as an innovation in instructional programming, it wo^id not be coiiiplete 
or thorough without taking into consideration the success of career education as 
a reform movement. This chapter will therefore examine not only the other ways 
career education's effectiveness as an instructional effort has been measured, 
but it will also include an analysis of the ways ia which career education's 
success as an educational reform movement haa been evaluated. 
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Indicators of Success in Affecting Students 



Any ntvtionvide product evaluation of career education programs is hangpered 
by the variety of ways in wnich the expected products of these programs are 
described and defined, Sciue single framevork is necessary to structure the 
collection and analysis of data pertaining to the effects of career explora- 
tion^ self awareness and occupational preparation activities on students' 
knowledge attitudes and skills. 

An appropriate starting point for constructing such a framework is the 
TBOE Office of Career Education's policy paper. An Introduction to Career 
Education (197^). Listed in the paper are nine learner outcomes expected to 
result from an effective career education effort: (l) Academic achievement, 
(2) good work habits, (3) meaningful work values and a desire to work, {h) 
career decision-making and employment-^seeking skills, (5) entry lev^l occupa- 
tional skills, (6) career choice, (?) awareness; of continuing education 
opportvinities 5 (8) successful job placement and (9) incorporation of work 
values into personal values. 

Also in 197^ J the Office of Career Education published the Handbook for 
the Evaluation of Career Education Programs which was prepared by Development 
Ast^ociates, Ir^^.^ of Washington, B.C. The Handbook offers an obdectives -based 
definition of career education which liot only includes most of the goal areas 
mentioned in the policy paper, but also expands upon these outcome aareas by 
specifying the kinds of knowledge, skills and attitudes students would demon- 
strate in achieving each goal. The Handbook's 33 objectives were reportedly 
the result of the examination of federal legislation and policy, descziptions 
of federal, state and local efforts to implement career education in all 50 
states and a variety of publications dealing with career education. State and 
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local practitioners met to discuss and reach consensus on the objectives. 
Considering this broad developinental base, the objectives' apparently close 
relationship to the goals listed in the policy paper and the straightforward, 
specific style in -which the oBjectives are stated, it was decided that the 
Handbook's objectives would best serve as the framework for analyzing data 
for this study. 

Four of the nine goal areas listed in the Handbook concern outcon»s wlich 
have been investigated in the earlier sections of this report. The five goal 
areas and accompanying objectives which will be the subject of this part of 

the stvidy axe as follows: 

I. Students will demonstrate increased self awareness: 

Ao Students will be able to describe their own current abilities 
and limitations. 

B. Students will be able to describe their own current interests 
and values . 

C. Students will display positive attitudes toward themselves. 

D. Students will recognize that social, economic,, educational, and 
cultural forces influence their development- 

VI. Students will demonstrate good work habits: 

A. Students will be able to plan work effectively. 

B. Student s'> will be able to adapt to varied work conditions. 

C. Students will have a positive attitude towards the concept of 
quality in relation to a work task. 

D. Students will have a positive attitude towards conservation of 
environmental and human resources in acconpllshing work tasks. 

E. Students will have a positive attitude towards responsibility 
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for their own behavior and accomplishment of self-iaogaosed work 
t asks • 

P. Students will de^&mistrate a desire for continuous learning, both 
in school and out. 
VII. Students will demonstrate work-seeking and work-getting skills: 

A. Students will be able to identify, locate, and utilize sources 
that contain information about existing p^vid and unpaid work 
possibilities. 

B. Students will be able to demonstrate skills required in applying 
for and accepting work. 

VIII. Students who are leaving the formal education system will be successful 
in being placed in a paid occupation, in further education, or in 
unpaid work that is consistent with their cs^-X^rent career education. 
IX. Students will be awai4 of means available for continued education 
once they hsm left the formal education system: 

A. Students will be able to identify souces of additional education 
in major types of paid and unpedd work. 

B. Students will be able to identify means to support additional 
education for themselves in major types of paid and unpaid work. 
(Development Associates, lie, pp. 6-8.) 

Most of the student outcomes being measured by curreiat career education 
projects are classifiable under one of the 15 objectives listed above or are 
classifiable under the objectives covered by the previous sections of this 
report. These student outcomes lAiich seem to have no relationship to these 
objectives will be treated separately. 
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Indicators of Success In Influen cing Educational Systems 

The Office of Career Education policy paper introduces career education 

as a reform movement designed to correct a number of social and educational 

probleiBS ranging from student apathy to worker alienation. The paper begins, 

Career education represents a response to a' call for education^ 
reform. This call has arisen from a variety of sources, each_of 
"Hhich has voiced dissatisfaction vith American education as it 
currently exists. Such sources include students, parents and the 
business-industiy-labor community, out-of-school youth and adults, 
minorities, the disadvantaged, and the general public. While their 
specific concerns vary, aU. seem to agree that American education 
irin need of major reform at all levels. Career edjication is 
Tjroperly viewed as one of several possible responses that could be 
giv^ to this call I^OE, Office of Career Education, 1974, p. 13;. 

Included in the paper is a list of "career education tasks" that must 

be done in order for a comprehensive career education program to be considered 

operational. These tasks are the activities which teachers, business -industry- 

i 

labor representatives, guidance and counseling personnel, parents, school 
administrators and school boards are urged to carry out in order to msOsB a 
credible response to the demands for twiucational reiorm. The implication of 
this Ust of operational tasks is that, were they to be iaiplemented in their 
entirety, the reforms sought by career education advocates would begin to take 
place. Involving parents, educators and community representatives as outlined 
in the "career education tasks" is an indication that the success of the 
career education as an educational movement reform is Imminent. 

The changes in educational policy aad practice advocated by the career 
educator, according to the policy paper, are difficult and can come about only 
after long study and debate. Any of the ik changes listed, if they were to 
actually come about, could be considered indicators of the success of careei? 
education as educational reform. The changes sought are these: 
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I. Substantial increases in the quantity, quality and variety of voca^ 
tional education offerings at the secondary school level and of 
occiipational education offerings at the post-secondary level. 

Increases in the nixmber and variety of educational course options 
available to students with a de-enphasis on the presence of clearly 
differentiated college preparatory, general education, and vocational 
education cuiricxxla at the secondary school level. 

3. The installation of performance evaluation, as an e:?> emative to the 
strict tinie requirements imposed by the traditional Carnegie unit as 
a o^ans of assessing and certifying educational accoioiplishment. 

k. The instcLllation of systems for granting educational credit for 
learning that takes place outside the vaUs of the school. 

5. Increasing use of non-certificated personnel from the business-industry- 
labor ccmniunity as educational resource persons in the educational 
system's total instructional program. 

6. The creation of an open entiy-qpen exit educational system that allows 
students to combine schooling with work in ways that fit their needs 
and educational motivations. 

7. Substantial increaises in programs of adult and recurrent education 
as a responsibility of the public school educational system. 

8. Ci*3atlon of the year-rotmd public school system that piwides multiple 
points during any twelve-month period in "tdiich students will leave the 
educational system. 

9» Major overhaul of teacher education programs and graduate programs in 
education aimed at incorporating the career education concepts, skills 
and methodologies. 

10. Substantial increases in the career guidance, counseling, placement 
and f ollow-xtp functions as parts of American education. 

II. Sifcstantial increases in program and sched\ile flexibility that allow 
classroom teachers, at all levels, greater awtonojoiy and freedoan to 
choose educational strategies and devise methods and materials they 
determine to be effective in increasing pupil £u:fcieventtnt. 

72. Increased utilization of educational technology for gathering, 
processing amd disseminating knowledge required in the teaching- 
learning process. 

13. Increasv^s in participation in educational policy making on the part 
of students, teachers, parents, and menibers of the business-industry- 
labor community. 

Ik. Increases in participation, on the part of formal education, in compre- 
hensive ccmnjnity education and human service efforts. (USOE, Office 
of Career Education, lS7h, pp. 25-26.) 
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Most of the process measurtJS employed by current career education projects 
are classifiable under one of the 2? "career education tasks" listed in the 
policy paper or are directly clattsifiable as contributing to one of the Ik 
changes in educational practice listed above. Those ^ch seem to have no 
apparent relationship will be treated separately. 

Talcing product and process evaluation measures together, 56 indicators of 
the success of career education efforts have been identified. These repressnfc, 
then, the ways people could try to assess the effectiveness of career 
education other than the assessment of djnprovements in students' academic 
' achievement, career awareness and decision-making skills. The "career education 
tasks" being conducted by career education projects must be considered means to 
t-wo interrelated sets of ends: Positive outcomes for students and desired 
changes In public educational policy and practice. Figure 1 illustrates these 
irxterrelationships . 



Conducting the 27 career 
education tasks outlined 
in the USOE policy paper 
on career education 




Effecting the ik cdiaiiges in 
educational policy listed 
in the USOE policy paper on 
career education 


increases 
the likelihood 
of: 

\ 


f 



Affecting students in 33 
specific areas as outlined 
by Develppmenfc Associates, 
Inc. , in the Handbook for 
the Evaloxation of Career 
Education Programs 



Figure 1. Relationship of Career Education Processes 
to the Expected Outcoanes of Career Education 
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Sources of Information for This Study 

The time avBllable for the ccaiqoletion of this study was too short to 
permit an exhaustive survey of the evaluation methods and measured results of 
the many career education pro^Jects -which have been conducted ±n the past four 
years. Instead, information vas sought from fovir distinct sou:rces "with the 
intention of sampling a range of professional perspectives on the- issue of ^:hCi 
efficacy of career education. 

The major sotirce of factual information ahout the results of current 
programs was career education practitioners themselves. Seventy-six (76) 
project directors were selected and asked to complete a mailed questionnaire. 
Each project met at least two of the following four criteria: 

1. The project was named by a state coordinator of career education as 
one which, to his/her laaowlec5ge had made a systematic effort to 
evaluate its iinpact. 

2. The project is located in a state named by Smoker (197^) as having 
made exceptional progress toward the fall implementation of the career 
education concept. 

3. The project is sponsored by^a school district revealed by Smoker •s 
study to have made substantial systemwide efforts to implement career 
education. 

k. The project is identified by Smoker as having received recognition in 
current literature for developing a comprehensive approach to career 
education. 

Another ijijKxrtant source of information used in conducting this study was 
the current literature on career education, particularly that sponsored or 
published by the U.S. Office of Career Education and the Education and Work 
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Task Force of the National Institute of Education. These sources were instru- 
mental in the formulation of hypotheses regarding the issue of the efficacy of 
career education and the subsequent construction of inquiries and questionnaires 
mailed to career educators and other potential sources of information. 

To balance the perspectives of the career education practitioners vho 
responded to the survey and the publications of the Office of Career Education 
and the National Institute of Education, recent NIE contractors and the 
research directors from 65 large school districts were also asked for input. 
The contractors were selected from abstracts of projects funded by NIE in 
FY73 and TTlk and listed in their publication. Career Education Program; 
Program Plan for Fiscal Year 197? . Those projects were selected which dealt 
most directly mth the eimluation of career education programs and vhose major 
emphases included career exploration or occupational preparation. Directors 
of research in school districts having enrolljnents of 50,000 or more were 
identified from a directory prepared by the Houston (Texas) Independent School 

District in February, 197^. 

Copies of the questionnaires and inquiries sent to career educators, NIE 
contractors and research directors are appended to this report. The questions 
■ these letters and questionnaires were designed to answer fall into two general 
categories: (l) Questions pertaining to the knovm results and effects of 
career education programs and (2) questions pertaining to the methodology 
applied in identifying program results and effects. The last category was 
considered important in establishing the credibility of reported program 
results and in identifying promising alternatives to the evaluation of 
developmental educational programs initiated at the national policy-making 
level. 
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Profile of the Career Edocatlon Pro.iects Stadled 



The career education projects which sxrpplied information for this part 
of the study probably represent the best efforts or* the nation's career 
educators. By being located in states -which vere recognised in a national 
survey (Smoker, 197lf) as having made significant conmitments to the 
io^ilementation of career education, these projects have had the support and 
assistance of state education officials for several years. By having been 
named by their states' career education coordinators as having demonstrated 
the iji5)act of their efforts, they are more likely than lesser known projects 
to have developed convincing methods of eval\aating and disseminating program 
results. 

Of the 76 projects surveyed, 32 (^2^) responded by supplying a completed 
survey and/or an evaluation report. Of the 65 inquiries made to large-district 
research directors > 17 (26^) returned completed survey forms. Seven of these 
supplied project evaluation materials. Two of NIE's Experience Based Career 
Education projects also supplied "written project information.. All together, 
kl projects were examined for this report. Of these kl projects, 26 described 
their evaluation results on the survey form or supplied written repor*;s from 
project evaluators. The findings report ed in the following sections are based 
on information supplied by these 26 projects. All kl responding projects are 
listed in the appendix. 

The typical project in the stuti/ saiiiple is partiaUy or entirely funded 
by federal Vocational Education Act fiends.* has been in operation at least 
three years and. serves a K-.12 student population. Eleven projects are funded 
at either the local or state levels and receive no federal support. 

104 

107 

o 

ERIC 



All of the projects reported having at least one program component relevant 
tc this part of the study. Thirty-five (35) reported having career exploration 
componeirts, and 34 reported having self -awareness caii?>onents. Only about half 
of these (l8) reported jot placement conponents. Occupational preparation in 
the form of classroom instruction is provided hy 29 projects' , and work experience 
programs are conducted by 25 projects. 

The survey form a^,ked -which of 13 goal areas are heing addressed hy each 
of the projects surveyed. Of the 3^^ responding to this item, the numbers 
reporting having goals in each of tbs relevait goal areas axe listed helow. 

Knowledge of good work habits 26 
Competence in career decision making, Joh- 20 

hunting skills, Joh -getting skills , 
Entry level occupational skills 1^ 
KnoH^ledge of continuing educa-cion 19 

qpporttmiti.es 

Successful placement in paid occupation, U 

further education or vocation 
Positive st"udent attitude towaid the 23 

program 

Positive teacher or administrator attitude 23 

toward the program 
Community knowledge and support of the 20 

program 

Student knowledge of their interests and 29 
abilities 

Prom 1 to 10 percent of the projects' budgets are allocated for evaluation 
of their programs. Seventeen (17) projects reported having internal evaluators 
on xheir staffs, most of whom were assign*^ part time.. Twenty-seven (2?) 
projects have contracted with external evaluators in addition to or instead of 
having an evaluator on their staffs. Host external evaluators are private 
consultants rather than university specialists. The kinds of evaluation designs 
entployed, the instnmientation used and the nature and reliability of these 
projects' evaluation findings are discussed in the remaining sections of this 
report. 
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Career Fi.ucation's Impact on Stxadents 



Fev of the projects in the study sample measured student outccaoe variables 
^ihich vere clearly related to the student outcome statements listed by 
Development Associates, Inc#> in the Handbook for the Evaluation of Career 
liducation PrOferaas » Although the greatest variety of /iieasured student 
outcoiaBs vere found to be associated with career exploration activities, it is 
difficult to separace the potential outcomes of career exploration from those 
of career orientation, career motivation or career ewareness activities. Therti 
seei5. to be no mutually exclusl^'e operational definitions of these canrpomrrt?:?.. 
It is appaarent from project descriptioaas that career exploration is a Ii^t.?tv 
stage of career development, but these project descriptions are quite imprecise 
"When it comes to naming program activities and student outcomes that relate 
only to the concept of career e3cploration» 

In addition to career exploration outcomes, career educators have also 
examined student cutcoroes in the areas of self -awareness and job placement. 
Little or no attention sec^^s to be being paid to the evaluation of occupational 
preparation progi'>dns. 

Impact on Students' Self -Awareness 

Table 1 on the following pages describes seven projects' efforts to 
measure "E-beir programs* effects on student self -awareness. The Self 
Observation Scale published by the National Tet^^ing Service of Durham, North 
Carolina, and the Career Maturity Inventory published by CTB/McGraw-HiU are 
nationally normed instruments, vhUe the remaining instruments list^sd in the 
table were locally developed.v Unless the nunibors of students and teachers 
surveyed by th-? New York project are exceptionally large, the differences in 
^ percentage of respondents giving desired answers to the survey items are not 
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likely to be statistically significant. The North Carolina project Tised 
regression analyses to identify the v^e of resource persons in the classroom 
as being associated with the iinprovement in the third graders* self -concepts. 
All other associated activities vere subjectively identified as being significant 
contributors to project success in improving student self -concept* 

Measured Career Exploration Outcomes 

The kinds of outcomes career educators have made some deliberate attempts 
to measure in the area of career exploration are described in Table 2. Included 
in this summary are evaluation results for program conrponeixts such as career 
motivation and career orientation as well as for components specifically 
referred to as career exploration. Generally speaking, the programs being 
conducted in these areas involve the in-class exposiare of students to the 15 
USOE career clusters. Little or no information was supplied about the kinds of 
classroom activities used as vehicles for exposing students to careers, and no 
project evaluation attempted to identify any relationships between particular 
student outcomes and the kinds of exploration activities in which they partici- 
pated. Consequently, no data were available for estimating the relative effec- 
tiveness of different kinds of career exploration activities. 

' For the outcomes and projects listed, it appears that positive student 
outcomes are more likely to result at the middle or juxiior high school level 
than at the elementary level. Elementary students* attitudes toward work and 
careers, their ability to relate occupational options to their own interests 
and abilities and their ability to make realistic occupational choices seem 
unaffected by participation in a career edi\cation program. 

At the jtinior high school and high school levels, reported resiats were 
positive in all but one case. The North Carolina project failed to demonstrate 
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any impcwt on seventh graders • awareness of the relationship of school and 
work, and found that a seventh grade control group had better vork habits as 
defined by the evalxzation instnzment they had developed. In most of the other 
cases, career exploration participation resulted in positive changes in know- 
ledge or attitudes that were significantly greate:: uhan changes measured among 
control or conrparison groups. In the case of some of the projects, no 
statistical comparisons were made, or measures were made only once instead of 
on a pre -post basis, so it is uncertain as to whether the reported ares\ilts 
are replicable or even attributable to participation in the career exploration 
experience. 

Effects of Occupation Preparation and Job Placement Programs 

Although 18 of the surveyed projects reportedly have job placement com- 
ponents and 29 have occupational preparation conrponenbs, only thrc^e project?' 
attempted to describe effects on participating students. In-school occupation 
preparation programs are conspicuously absent from the i/rogram descriptions 
STjqyplied by the surveyed projects, and work experience programs are mentioned 
only infrequently. Ko attention is given in the projects* lists of antici- 
pated student outcomes to the high school graduate's need to posser>?3 a salable 
skill if s/he does not plan to enroll in a postsecondary educational program. 

A student follow-up survey from a large Oregon school district showed 
that 95 percent of the 1967, 19^9y 1973 and I97U graduates felt that schools 
should help students develop employment skills and ccoqaetence to enter the job 
market. Eighty-seven (87) percent felt placem e n t services should be available 
to all high school students. In contrast, when asked how they obtained their 
first job after high school, less than six percent said they had received help 
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frcan a teacher or a counselor or had gotten a job through a work experience 
asslgmoent • 

Another, smaller, Oregon school district T«hich had conducted a career 
education program for three years sxmreyed its high school grad\iates for 
1972, 1973 and 197U. Students who had taken career cluster courses and coop- 
erative work experience in Mgh school were found to be wore likely to be 
working in their chosen career area than vocational, academic or general studies 
students. More vocational and cluster students said their high school experience 
had helped prepare them for their chosen career area. It was also found that 
more 197U graduates than 1972 gradmtes made tentative career choices before 

leaving high school. 

In Pennsylvania, a project called a vocational educr.'^ion counseling system 
which had job placemenb as one of three project can)i>onents reported having 
placed in jobs 100 of 1,878 students interviewed. The evaluation report does 
not state whether this number of placements was satisfactory or not. An 
attitude suirvey of 75 fomer Cooperative Work Experience students failed to 
yield enough replies to estimate the effectiveness of the counseling and place- 
ment services offered them. 

A Wisconsin project which estetblished numerous contacts with local employees 
and the state eaplpsnnent agency and >Thich offered a variety of engxloyment 
coxanseling services reported that "the number of students who took advantage of 
these opportunities could have been greater." Though students had received 
increased plac^axaent services since the last year, two problems were cited as 
barriers to greater success: (l) High school placement personnel needed to 
becoBje more knowledgeable about careers and (2) the role of the counselor 
needed to be changed. 
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High school students in an Arizona career education project vere asked, 
"If you had to leave school at the end of this year, how veil prepared are you 
to fiaid a job?" Sixty-five (65) percent of the students said they vere pre- 
pared vbile 52 percent of the students not involved vith the project said they 
felt prepared. These same students completed an instrument which measured 
their preparedness for en5)loyment in several occupational clusters, their 
ability to complete job applications and their ability to differentiate between 
an entry level job and future mobility within a job cluster. Although project 
participants did significantily better on this instrument than students not 
invonred in the project, fewer than a third of the students demonstrated these 
employability slcills. 

a 

Student Attitudes Toward Career Education 

Nearly half of the projects for which evaluation results were supplied 
demonstrated Interest in students' general reactions to participation in a 
career education program, either in terms of their attitudes toward career 
education or their attitudes toward school. Table 3 summarizes the results 
of these projects' efforts. 

Generally spealcing, students respond positively to participation in career 
education activities regardless of grade level or type of program. There is 
some indication that student attitudes toward school became more positive after 
participating in career education activities. Although these results are 
encouraging, many projects rely almost exclusiveily on subjective attitude 
measures as indicators of project success and of those who do, many do not 
utilize pre-post measures and/or comparison or cc^ntrol groiips in arriving .?*^ 
their conclusions. The third party evaluator for a large California project 
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cautioned against reliance on one-time self -report measures of attitudes: 



These data provide primarily perceptions azKL attitiodes 
of project sttBdenrts "based on self -report instruments. 
Although these data are xisefal, conclusive evidence of 
the inipact of the project on student Imowledge and 
attitudes would require con?>arison with a similar grcrap 
of students not exposed to project activities. Further- 
more, determination of actxtal changes in hehavior and 
knowledge gained would require use of more oh jective 
assesstoencit devices. These could taloe the form of ohser- 
vation of student hehavior and instruments sampling 
knowledge of the areas specified in the project ohjec- 
tives. 



Career Education's Bnphasis on Process 



In examining each of the projc t evaluation reports submitted ft r this 
part of the study, it was generally difficult to locate and compile strident 
outcoane data hecause most project officials appear to equate evaluation with 
the documentation of project activities and processes leather than with the 
documentation of the results or products of those activities. Many career 
education evaLLuation reports axe a proliferation of metictilously outlined process 
ohjectives and carefully tallied evidence of the staff's progress toward com- 
pleting these planned activities. Many State departments and local school 
dist3Picts all across the country reveal their serious commitment to the im- 
plementation of career education by producing elaborate long-range plans for 
the incremental integration of career education functions and processes into 
the educational mainstream. Anticipated effects ot career education activities 
on the participating students* attitudes, skills and knowledge are rarely 
outlined in the same amount of detail and occasionally appear to have heen 
added to a plan as "window dressing" or as an afterthought. 

Tue processes and activities which receive the most attention f!rom career 
educators fall into two categories, the first of ^»hich uiuten appears to he a 
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career education projects* only piarpose; 

!• Activities designed to change the traditional roles aod behaviors 

of teachers and counselors. 
2. Activities designed to increase the si^^rt for and involvement with 

ediication among members of the community, particularly parents and 

potential exnployers-^ 
The first category may be further subdivided into activities related to the 
develqpanent and dissemination of career education materials and activities 
related to iLnservice training and consxaltation services for teachers and 
counselorr • 

In the case of the development and dissemination of career education 
materials, most projects reported the number of items produced and the nuniber 
of teachers known to be using them in their classrooms. Almost all recorded 
attenjrts to evaluate the materials for production quality and instructional 
effectiveness involve asking teachers for general opinions in end-of-year 
surveys rather than applying any systematic criteria to the evaluation of 
specific iteii:J5r\. 

Inservice programs and consultation services for teachers and counselors 
are evaluated in terms of the numbers of people who enroll or the numbers who 
request project assistance, these data presumably being indicators of interest 
in career education and willlagn^^ss to participate in its Implementation. 
Some of the projects in the survey sample conduct periodic surveys to determine 
teachers ■ and counselors ■ attitudes toward career education concepts and their 
cLegyee of support for the project. Students occasionally are asked to report 
the frequency with which their teachers introduce career education topics in 
their classes or the kinds and amounts of assistance they have requested from 
school coxonselors • 191 
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Parent and employer involvement activities are evaluated in much the same 



vays as educational staff development activities are evuluated. Numbers of 

parents ^o attend careers-related events at school are reported as evidence 

of their interest and involvement in their children's career development. 

Employers at vork e3q)erience sites axe asked to rate students' genercuL attitude 

and performance at the vork sites and are asked for their reactions to career 

education concepts and programs. 

To con^rsy the range of success the s\arveyed career education projects are 

experiencing vith the implementation of career education processes in the above 

categories, the following excerpts from their evaluutiun reports are presented: 

The overall objective was to produce 250 ^cuiriculum]] units. 
A reriew of documents presented by the project staff indicates 
that 276 \mits were produced during the three-year project.... 
ThTis, for «n intents and purposes this overall objective was 
met so far as the qxiantity of cvirriculum units produced is 
concerned. ( Calif ojriaia - k) 

When asked how much they had used cecreer education teac h ing 
units, developed by subject matter teachers for their 
discipline, only three of ten responding staff members 
(29.2I) replied that they had used the units to a somewhat 
or great extent; one-half (50.0^) replied little or not at 
all. (Colorado) 

Twenty-five percent more teachers of grades K-6 and 6I per- 
cent of grades 7-8 provided four or more activities in 
19711-1975 than in previous yearo 1973-197^—62 percent of 
teachers provided four or more activities. 197^1975~82^ 
of teachers provided four or more activities .. • 8O.5 hours 
of formal pre- and in-service in 66 sessions were provided 
with l,8o!4- persons logged in attendance with extent of - 
participation of each group noted. (Arizona - l) 

Using the CaJdfomia Department of Education and Ceres 
Unified School District goals as a model, 25^6 of Ceres 
Unified School District Elementary Staff will know the 
goals and objectives develaped by the 1973-7^ Career 
Education Matrix.... Objective met: 2^^ of elementary 
staff know the goals and objectives. See Appendix I for 
summary of evaluation data. (CcuLifomia - l) 
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Do teachers have a positive attittide towards career education 
as a result of exposure to in-Bervice training activities? 
Only tventy (20) percent of the 65O teachers responded to the 
aSitude survey. Of those that did, all had a positive attitude 
towards career education and seemed to be quite knowledgeable 
about it. However, there were no differences in the attitude 
of teachers who attended the workshop and those who did not 
attend it. (Minnesota) 

Involv«A teachers completed a staff reaction (evaluation) sheet. 
A total of eighteen (I8) teachers completed the evaluation.... 
The majority of reports contained positive reactions and offered 
constmctive suggestions. (Ohio - k) 

Local guidance staff increased their direct involvement in the 
career education program during Phase II. One counselor froa 
each secondary school participated in each of the summer career 
education curriculum writing workshops jji 1973 and ig?**. 
During this time role descriptions were developed, and group 
guidance activities were developed.... The activitiee Just 
described are but a few of the efforts to redirect guidance 
staff and services in the public schools. There can be little 
doubt that, this grant has had an impact on improving guidance 
services to sttidents and increased the involvement of guidance 
personnel in the career education program. (Wisconsin - 1) 

Parents aad personnel from bvisiness and industry were vised as 
resource speakers and in an advisory capacity. Direct contact 
was made with parents for the purpose of explaining Career 
Education and its goals. The Post High School Opportunity 
Night progi^aii brought many parents into the school as well as 
numerous reipresentatives of the business and industrial 
community. (Ohio - 5) 

Ninety-two percent of the parcnts responded that the role of 
a parent in the career choice of a student is to encourage 
self -responsibility. ...Yet, when these same parents were 
asked how far in school they expected their children to go, 
. . .only nineteen pes-cenb of the parents stated their children 
could decide for theaselves. ...These findings indicate that 
imxch more work needs to be done with parents in order to 
expand their conceptualization of the economic marketplace. 
(Arizona - 2) 

Business and industrisO. caaminity response to a -questionnaire 
showed that two-thirds of those returning the survey Instru- 
meixt were familiar with the Career Based Curriculum in the 
Union County Schools and two-tbirds of those responding feel 
the "activities will be of subsiaatial value to the canminity.' 
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Although the biislness and industrial community respondents 
indicated they don't believe career education is Just another 
fad that will soon be forgotten , there vas not consensus abovit 
career education as a secox^dary program ooQy or as an izxbegral 
part of the K--12 program. (North CajroHna) 

■ 'j-'d 

Career education projects • concentration on process rather than product 
evaluation is reasonable in light of the national goals for educational reform 
published in the Office of Career Education's official policy paper. Projr^cts 
funded from the national level understandably could be eagr^cted to reflect the 
fervor for reform conveyed by An Introduction to Career Education . The desired 
reforms (listed at the beginning of this paper) 9 however > represent substantial 
departures troai educatioxia]. practice and so must be striven for in an incremental 
fashion. By providing evidence of the degree to which their projects have been 
able to induce teachers, coxmselors , administrators, parents and members of the 
employment community to perform "career education tasks" like those LI,sted in 
the policy paper, career educators are documenting their incremental efforts 
toward reform and are demonstrating how their projects are contributing to the 
success of ca^er education as an educational reform movement. The relative 
araotmt of attention they devote to specifying and measuring the student out- 
comes of their projects is directly proportional to the priority implicitly 
assigned the learner outcomes listed in the policy paper. 

Reliance on process evaluation methodology in assessing the success of 
career education programs may be the result of necessity rather than choice ^ 
however. The kinds of student outcomes sought from career education programs 
cazmot easily be reduced to precise, observable behaviors ^Aiich all career 
educators would readily agree represent the full range of behaviors implied 
in the general goal statements. Career education is a response to a general 
dissatisfaction with the "typical" American's ability to assume the respon- 
sibilities of being a productive member of adult society. Deducing the specific 
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skills and imowledge needed to correct this sittoation is destined to be a 
difficult (and perhaps Unpossihle) undertaking. Until such performance 
criteria are developed, however, product evaluation results will prohably not 
he very convincing evidence of the efficacy of career education unless accom- 
panied hy substantial process evaluation information. 

Another barrier to credible product evaluation is the status of career 
education measurement technology. Relatively few standardized evaluation 
instruments have been developed so far. Their applications to career 
education programs are limited, and their validity is in some cases yet to be 
established. In the absence of valid, reliable measures of career education 
outcomes, project d^iqpers have had to develop their own Instruments. 
Restraints of time, money and skill appear to have prevented the development- 
of local evaluation instruments that mea^ student ourcoK! as directly and 
as ac^^ately as possible. Unless a project's staff includes an experienced 
evaluation specialist, it is unlikely that locally developed instruments will 
yield valid and reliable information about the project's dinpact on participating 
students . 

SnTnm«.rv and Conclusions 

The major purpose of this part of the report was to determine the efficacy 
of career education programs in areas other than academic achievement, career 
awareness and career decision making. Forty-one {hi) career education projects 
responded to a survey designed to identify the effects on students of these 
other career education cooponents, particulai^j career exploration, occupational 
preparation and job placement. About three-fourths of the responding projects 
'^.re supported by Vocational Education Act funds (Parts C and D) while the 
remainder were funded at the state and/or local levels. 
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The sttJdent outcomes measured by the responding projects vere loosely- 
categorized into these areas: (1) Self -awareness, (2) career eaqploration, 
(3) occupational preparation and job placement and {h) general attitudes toward 
career education. From the data reported by the surveyed projects the following 
tentative conclusions can be drawn about the efficacy of career education in 
these four are':**^! 

1. Participation in career education activities appears to have a positive 
influence on students' self -concept and general self -awareness, 
particularly in the primary grades « The amount of influence reported 
is extremely variable, however, ranging ftran no significant differences 
between participating students and control groups in a few projects 

to statistically significant increases in self -concept in other projects. 
Virtually no projects are able to relate outcomes in this area to 
specific program activities, so there is no way of establishing the 
relative effectiveness of different kinds of career edxication activities 
designed to increase student self -awareness* 

2. Elementary and Junior high school sttidents involved in what projects 
term career motivation, career orientation and/or career exploration 
activities seem to respond differently. Elem^ntaEy students seem less 
likely to acquire positive attitudes toward work and seem less capable 
of relating their interests and abilities to ocozpational options in 
making realistic tentative career choices. Most studeirts like the 
activities in which they participate and develop more divergent career 
interests as the result of their participation. 

3. Viirtually no effort is being made to mecusure the effectiveness of 
occupational preparation and Job placement programs. None of the 
projects surveyed had written objectives describing the intended out- 
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comes of such activities in terms of the occupational skills students 
should possess ttpon leaving school or the proportion of successful 
job placements escpected. 
l^, Students in grades K-12 generalJ^jr respond positively to participation 
in career education programs. Their attitudes toward career education 
and toward school in general appear to iniprove with increased exposure 
to CEireer education programs and services. 
The conslusions stated here are very tentative and should not be used in 
determining career education policies unless they are heavily supplemented by 
other kinds of information. Some of the reasons for urging such caution are 
listed below. 

1. True experimental evaluation designs are seldom used in measuring 
program impact on students. When comparison groups are used, no 
apparent attempts to prevent contamination are made. 

2. The objectives of the different career education components are 

' ■ ambiguous and often imprecise. VJhat one "career exploration evaluation 
instrument" measures, for example, may be entirely different from 
what another instrument of the same title measures. Consistent results 
from a number of "career exploration evaluation instruments" could be 
very misleading. 

3. The specific treatments comprising career orientation, career motiva- 
tion, career exploration or .any other program component are extremely 
variable and virtually no projects attempt to systematically identify 
what particular activity (or series of activities) is associated with 
what particular student outcome. Without this kind of information, 
evaluation findings have little value to someone who wants to design 
and implement a potentially successful- career education program. 
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These fittflingi; axe congruent with the findings and general concluflions of 

another, more rigoroos stxidy of the results of the first three years' efforts 

to implement programs under Part D of the Vocational Educational Act. Ifader 

contract with the USQE Division of Vocational and Technical Education, Bevelx3(pment 

Associates of Washington, D.C., concluded in their March, 1975 j report: 

Projects were typically not well defined in terms of purpose 
or clientele and this lack of clarity may relate to the 
failure in many parojects to identify student outcomes 
significantly related to project activities (p. 3). 

A review of the stated objectives of the 50 projects reveal 
that in many cases the activities called for by the policy 
paper were not addressed. In addition, a compazdson between 
stated objectives of projects and activity categories 
indicated that in many projects the performance of activities 
could not be related to the stated objectives (p. h). 

The definition of key terms and concepts was neither precise 
nor consistent at either the federal or locauL levels, ..•This 
failure to establish operational definitions and categortes 
contributed to the inability of projects to identify witir 
assurance participants in the programs and to the inability 
at the federal level to monitor project efforts effectively. 
(Development Associates, Inc**? 1975 > P» 6.) 

In the course of examining the career education pzrojects in the study 
sample for evidence of success in achieving desired student outcomes, it 
becomes apparent that an entirely different approach to evaluating project 
success is being used. This alternative to standard product evaluation is a 
kind of process evaluation designed to demonstrate career education's effec- 
tiveness as an educational reform movement. The relatively heavy emphasis on 
the processes and activities of career education in the USOE policy paper. An 
Introduction to Career Education , is proposed as one of the possible reasons 
for a penchant for cotmting the career education materials developed, dissemi- 
nated and used, for counting the number of teachers and counselors who partici- 
pate in inservice activities and for surveying parents and potential employeris 
for their attitudes about career education concepts. 
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other possible reasons for the heavier eniphasis on process measures are 
the lack of clarity and consistency in career education goals aaad ohjectlves 
and the lack of valid and reliable instruments for meas^ufiEg. program impact. 
Whate-vrer the reason for career educators' concern for processes and their 
apparent lack of systematic attention to student outcomes, the evidence of 
success career education projects are able to produce is more clearly related 
to the presumed need for educational reform than it is to career education's 
success as aa instructional innovation. 

In summary, the career educator is finding it both desirable and expedient 
to focus evaluation efforts on gaugiiig levels of support and acceptance for 
career education programs rather than on measuring such programs' short- and 
long-tem. influences on students' ability to link education and vork in shaping 
their careers. Dr. Kenneth B. Hoyt, Director of the U.S. Office of Oareer 
Education, very accurately described the status of current career education, 
evaluation efforts in his address to the March, 1975, USQE Career Education 
and Teacher Education Conference- 
It seems safe to say that the quantity of effort expended at the 
local school district level has exceeded the quality of that 
level by a very vide margin. Evaluation efforts, Tifliile generally 
yielding positive resiits, are found only infrequently and, by and 
large, are lacking in convincing quality. This lock of sound 
evidence of effectiveness has not seemed to daii?>en local 
enthaisiasm for career education. It seems appropriate to say 
that, by and large, career education has been accepted on 
faith— and that an abundant amount of f€d.tli esLsts (p. 4). 

Recommendations 

Policy maJsers at the national level are in the best position to take 
advantage of the developmental work of the nation's career educators over the 
pafit four years. Iractitioners of career education, given adequate direction 
aiid appropriate inceirtives, can draw upon their past experiences and make 
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significant contrilDittioiis to a national ejpfort to define career ed\ication xoore 

clearly and identify the most effective strategies for achieving its goals. 

The enthxisiasm reportedly being generated hy cuirent career education projects 

across the coimtry in the absense of consensus as to ^rtiat constitirtes career 

education in practice and in the absence of convincing evidence of these 

projects' overall effectiveness should alert policy makers at all levels to 

the dangers of "oversell." Dr. Rupert Evans, in preparing the epilogue to 

the Office of Career EdTication's publication. Career Education; The State of 

the Scene , recognized this danger: 

The sudden popularity of career education may prove to be its 
own vorst enemy, for almost everyone will try to use it for 
their own ends. Thus the key question may well be: "what 
is not career education, and how can it be prevented from 
masquerading as the genuine article; thus diverting attention 
and resources from the goals and activities to which real 
caresr education is addressed? (p. 272) 

Local, state and federal level career educators could work together to 

more clearly describe "the genuine article" and to more precisely define *'the 

goals and objectives to which real career education is addressed" by taking 

the following steps: 

1. Reach consensus on national career education goals in texms of sttident 
outcoones e3cpected at each stage of career develqpnent. 

2. Analyze these goals carefully and reduce than to perfortaance criteria 
that can be used to guide the planning and evaluation of career 
education programs » 

3. Educate prograa planners, local, state, and federal policy-making 
bodies, and those who administer career education projects. about the 
means-end relatioxisbip between caareer education processes and career 
education products to prevent the develppneirt, approval ai^ lngplemen- 
tation of projects whose escpressed purposes are to conduct activities 
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rather than to effect desiared sttideiit outcomes. 
k. Develop and standardize evaliartion instruments that will reliably 
measure a program's effectiveness in helping students acquire the 
attitudes, skills and Imowledge represented hy the performance criteria 
resulting from the analysis of national career education goals. 
5. Support career education projects ^ch include carefuUy thought out plans 
for the systematic valitobion of program processes and the rigorous 
evaluation of program outccanes. 
If cac«er education is to became an integral part of education practice, 
practitioners and policy malcers must he prepared to appOy more ti^an enthusiasm 
to- the effort. Enthusiasm, conviction and the drive for reform are perhaps 
sufficient to create widespread commitment to career education, but if career 
education is to became a long term productive force in education, it is going to 
require much more. All career educators must be prepared to devote to tbe task 
a great deal of "conscious effort, other /bhan that involved in activities whose 
primary purpose is either coping or relaxation, aijsed at producing benefits for 
oneself and/or for oneself and others." In a word, career educators must be 
prepared to work . 
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DEPARTMENT OF HEALTH. EDUCATION, AND WELFARE 

OFFICE OF EDUCATION 
WASHINGTON. D.C. 20207 

July 29, 1975 

TOs Each State's Coordinator of Career Education 

FROM: r-ur. John Michel, Acting Director of the National Advisory 
Council for Carreer Education, 



The council has recently contracted with four individuals to prepare a 
paper entitled. The Efficacy of Career Education , As a state coordinator 
of career education, you can direct these individuals to career educators 
in your state who have made systematic efforts to evalTiate the impact of 
their programs. The Council is parti culearly interested in the eyal^ati^Ji 
methodologies and measured resul-cs of programs whose objectives invalue: 

1) the develofanent of career aweureness 

2) the maintenance or improvement of academic achieveiaent 

3) the development of career decisionmaking skills. 

Other program emphases such as career exploration, career prepairation and 

job placement are also of interest to the Council in their effort to establish 

the full impact of the career education programs around the United States, 

In the space below, please enter the names of projects you feel should be 
included in the Council's study, and supply the contact information and 
program classification requested,- Mail yoiir list of projects in the 
enclosed self-addressed envelope* In order for your input to be 
considered in this study, it is important that your input be received 
no later than AUGUST 15, Thank you for your cooperation. 



PROGRAM bR PROJECT TITLE NAME, ADDRESS AND PHONE AREA(S) EMPHASIZED IN 
AND FUNDING SOURCE OF CONTACT PERSON PROGRAM'S OBJECTIVES 
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TUCSON PUBLIC SCHOOLS 

ROBERT O. MORROW EDUCATION CENTER 
P.O. BOX 4Q40 
IQIQ EAST TENTH STREET 
TUCSON, ARIZONA 85717 

September 9, 1975 



Dear Career Educator: 

Yotir state is recognized as one ^ich has made significant progress 
in the implementation of comprehensive career education, aad your state s 
career education coordinator has named your project as one xvhich has 
made systematic efforts to measure the inipact of career education. For 
these reasons I would like you to fill out the enclosed questionnaire 
about how your project is being evaluated and the results you have been 
able to document thus far. 

The National Advisory Council for Career Education, which has 
commissioned this study, was established by Congress to assist practi- 
tioners with the implementation of career education programs and to 
recommend any needed changes in national career education policies and 
priorities. Establishing the efficacy of current career education 
efforts and disseminating promising evalmtion strategies are some of 
the Council's first responsibilities, so your cooperation in responding 
to this questionnaire is very important. 

Please return your completed questionnaire to me as soon ag possible. 
Information about your project must be in my hands by September 26 in 
order for it to be included in the report to the Council. A stamped, 
self -addressed envelope has been enclosed to assist you in maJcIng a 
prompt reply. 

Thank ^ou for taJdJig this opportunity to contribute to the Iffi-prcrve- 
ment of strategies for evaluating career education and the formation of 
future national career education policy. I look forward to hearing from 
you soon. 

Sincerely, 

Sherrie Schager y 
Researcsh Specialist 
Department of Research and 
Evaluation 



rs 

Enclosures 
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Survey of Career Education Evaluation Practices 

for the 

National Advisory Council for Career Education 



1. Naaae of your project: 

2. Location and sponsorijag agency: 

3. So?trcu of funding: 

Local or county 

State 

Federal (check source) 

VEA, Port C 

VEA, Part D 

PL93-380, Title IV 

Other: 



5* Grade level of participants: 
Elementary 
. Middle or Junior High Sch. 
High School 



?• Program components: 

Career awareness 

Career eDqc)loration 

Self-awareness 

Career decision-making 

Joh placement & follow-up 



No. of years in operation a m: 
cf 197^75 year: 

(if no longer in opc-cttion, give 
last year: ) 



6. Which of these groups, if any, are 
given special attention? 

Low-income 

Ethnic minority 

Female 

Handicapped 

Dropout or potential dropout 



Career preparation 

Classroom instruction 

Work experience 

Occupations not requiring a B.A. 

Occupations requiring a B.A. or more 



8. For ^rtiich of these areas does your project have written goals and/or hehavioral 
ohjectives? 

Competence in "basic academic skills 

fiaowledge of good work habits 

Positive work values and a desire to work 

Competence in career decision-making, job hunting skills, idb gettiiig 

skills 

Entry level occupational skills 

Appropriateness of caoreer decision, considering interests, abilities 

and career cirportunities 
Knowledge of contii:tulng education opportunities 

Successful placement in paid occtcpation, further education or vocation 

Positive student attitude toward the program 

Positive teacher or administrator attitude toward the program 

Community knowledge and support of the program 

^ Student knowledge of career clusters 

Student knowledge of their interests and abilities 

Other: 



9. Percent of hudget allocated for evaluation: j5 
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10. Kind of evaluation assistance used: 

Internal evaluator 

" FuU-time 

'^^^^1^^ Half -t jjne 

Less thaji half-tiire 

' No eviLuator is used 



11 • Frequency of evaluation reports: 
Monthly 

Two or three times a year 
"~~ Annually 

(ITO formal evaluation repc 



External evalmtor 

University specialist 

Private consviltant 
Other: 



12. Evaluation d.es±cn{s) used: ^ .-^o.^^^^ x.^. 

One-time, end-of -program measures admnisoered to. 

ProGram participants only 

Program participants and a control group 

l^rogram participants and a coTi?)arison group 

Pre- and post-program mea:3ures administered to: 

Program participants only 

Program participants and a control gro\ip 

Prograjn participants and a comparison group 

Some ether design (describe): 



outcomes : Each of the areas covered by your objectives (the ones 
— ^ you checked in Question No. tij. 

V-.. p.c.nt Fleeted- The tehavioral or performance outcome expected 
M eannrahle Re3uJ.t ^ ^^^f ^^^^^3 outcome listed in the first column. 

Data Conection : The r^thod or instrument you used to collect the data. 
Actual Results : The actual results, descril^ed as quantitatively as possll^le. 

"ax, exeu^le is given to help you fill in the chart ^^J^ f^^^, 

LTSund U3e?ul Wd also 

be appreciated. 
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TUCSON PUBLIC SCHDDLS 

ROBERT O. MORROW EDUCATION CENTER 
P.O. BOX 4040 
1Q1Q EAST TENTH STREET 
TUCSON, ARIZONA BSTl? 



September 17, 1975 



Dear Research Director: 

I am currently \mder contract with the U.S. Office of Education 
to prepare part of a report for the National Advisory Council for 
Career Education describing the nature of career education evaluation 
strategies currently in use throughout the country. You can help me 
greatly hy taldng a few minutes to answer W questions and sending 
me any releva^ reports your district has prepared. Your ohjective 
viewpoint will he especially valuable in the preparation of an 
accurate and informative report for the Council. 

I am particularly interested in knowing the objectives, evalua- 
ti on designs , instrumentation and measured results of career education 
programs initiated since 1971-72 involving 6th through 12th grade 
students in (l) career exploration activities, (2) preparation for 
occupations, particularly those requiring post-secondary education, 
(3) doh placement and {k) post-graduation follow-up studies. 

Your prcotpt reply to the enclosed questions will he greatly 
appreciated. A stan^ped, self -addressed envelope is enclosed for 
yovir convenience. 

Sincerely, 



Sherrie Schager ^ 
Reseaarch Specialist 
Resecorch Departxnezrt 



rs 

EnclostJres 
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KEASE RETUHN .BEFORE SEPTEMBER 30 



Sxmrey of Cetreer Education Evaluatloa Practices 

for the 

National Advisory Cotmcil for Career! Education 



Your Name a»d Position: 
Address: 



1. Please describe your district's efforts to systematlcELQy evaluate the 
effects of career education programs for middle/ junior high school and 
high school students since 1971-72: 

a. Our district did not conduct any career education .programs of the 

type you describe between 1970 and the present. 

b. Such career education activities have been conducted, but to my 

Imowiedge, -were not formally evalua^ted. 

c. Some career education austlvitles of the hind you have described 

have been conducted and have been formally evaluated: (Check one.) 

(l) Summary(les)/abstract(s) of evaluation results enclosed. 

(2) Pull report(s) enclosed. 

(3 J Report (s) available, but at a cost of . 

{k) No report(s) or areport simmiary(les) available. 

• d. Such a program is presently being conducted, but no evaluation 

results are iavailable yet. 



2. Your pTOfessloiml opinion regarding any of the following questions or related 
issues would be veiy mach appreciated. (Pleas'e indicate whether or not your 
remarks may be quoted in the report to the National Advisory Council: 
yes; no.) 

a. What seem to be tfie positive outcomes of career education? 

b. Which goals seem to be achieveable througjx which mechanisms? 

c. What have been the most useful measures in jtidging the effectiveness of 
career education? 

d. Which strategies serve which populations best at .reasonable cost? 

e. What are the relative costs, human and financial, of different approaches? 

f . Which occupations are being studied effectively within schools, and which 
seem to require learning outside school walls? 



Pleaae use the space below and the be^ of this page for your conmients. 
Thank you for your valuable assistance. 
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TUCSON PUBLIC SCHOOLS 

ROBERT O. MORROW EDUCATION CENTER 
P.O. BOX AOAO 
IQID EAST TENTH STREET 
TUCSON, ARIZONA B5717 



September 15, 1975 



Dear 

I am currently under contract with the U.S. Office of Education 
to prepare part of a report for the National Advisory Council for 
Career Education descrihing the nature of career education evaluation 
strategies currently in use throu^out the countiy. You can help me 
greatOy hy sharing some of the knowledge and insights you may have 
gained in 



W investigation is primarily concerned with the effects on junior 
high/middle school and high school students of programs involving 
career exploration, occupational preparation, joh placement and student 
follow-up^tivities. I will be particularUr interested in descrihang 
the ohdectives of such programs, the evaluation designs and instru- 
mentation used and, of course, the measured results of these programs. 
In addition to any reports or materials you may he ahls to si^ly me 
pertinent to these issues, I would also like to have your professional 
opinion of the degree of progress you helieve is heing inade in 
assessing the effectiveness of career education efforts. i.Please 
indicate in your reply whether or not I may quote from your remarks xn 
my report.) 

Because your input will he especially valuable, I am looking 
forward to hearing from you soon. 

Gratefully, 



Sherrie Schager 
Research Specialist 
Research Department 
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Career Education Projects Who Responded to the SurvBy 
(Listed alphabet ica3Jy by location) 



AKEZOm 



HAWAII 



1. Comprehensive Career Education 

Project 

Roosevelt School District #66 
Phoenix, Arizona 

2. Pima County Development all. 

Career Guidance Project 
Pima County Superintendent 

of Schools 
Tucson, Arizona 

CALIFORNIA 

1. Ceres Model— Career Education 

Responsive to Every Student 
Ceres, California 

2. Pupil Personnel Services 
Grossmont Union High School 

District 
Grossmont, California 

*3. Comprehensive Career Education 
Model 

Los Angeles Unified School 

District 
Los Angeles, California 

k. Orange County Consortium 

Career Education Model K-lU 
Orange Unified School District 
Orange, California 

•^^5, Santa Barbara Career Education 

Project 
Santa Barbara High School 

District 
Santa Barbara, California 



Hawaii Career Development 

Continuum K-1^ 
State Department of Education 
Honolulu, Hawaii 



IOWA 



•^1, Career Information System :;f 
lom 

Iowa Department of Public 

Instruction 
Des Moines, Iowa 

^2, Comprehensive Career Curricultxm 
Des Moines Independent 

Community Schools 
Des Moines, Iowa 



MICHIGAN 



Human and Compxrber Assisted 
Career. Achievement Skills 
Training Program 

Pontiac Public Schools 

Pontiac, Michigan 



MINNESOTA 



Project CEASE— 'Career Education 
and Staff Enhancement 

Noi'th Saint Paul-Maplewood 
Schools 

Maplewood, Minnesota 



MISSOURI 



Career Education Project 
St. Louis Public Schools 
St. Louis, Missotiri 



COLORADO 



Esqoloratory Program in 

Careers (EPIC) 
Denver Public Schools 
Denver, Colorado 



* Not included in analysis because no evaluation results were submitted. 
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NEW JERSEY 



OHIO 



1. Asbury Park Career Development 
Education Project 
Asbury Park Board of Education 
Asbury Park, New Jersey 

2- Career Education K-12 

Jersey City Board of Education 
Jersey City, New Jersey 

*3. Millville School System K-12 
Millville, New Jersey 

*4. New Brunswick Career Education 
Model 

New Brtmswick, New Jersey 

5. Career Education 
Passaic Public Schools 
Passaic, New Jersey 

6. Governor's Career Development 

Proj ect 
Perth Amboy High School 
Perth Amboy, New Jersey 

7. Career Education 
Salem, New Jersey 

NEW YORK 

*1. Project Open Door to the 
World of Work 
Buffalo Board of Education 
Buffalo, New York 

2. New York State Consortium for 
Career Education 
Syracuse, New York 

NORTH CAROLINA 

Career Based Curriculum 

Project 
Union County Board of 

Education 
Monroe, North Carolina 



1. Career Education Project 
Cincinnati Public Schools 
Cincinnati, Ohio 

2, Career Development Program 
Dayton City Schools 
Dayton, Ohio 

*3. Career Education 

Geneva Area City Schools 
Geneva, Ohio 

4. Career Continuum 
Southwestern City Schools 
Grove City, Ohio 

5. Career Development Project 
Lorain City Schools 
Lorain, Ohio 

*6. Mansfield Career Development 
Proj ect 
Mansfield City Schools 
Mansfield, Ohio 

7. Willoughby-Eastlake Career 

Education Program 
Willoughby-Eastlake City 

School District 
Willowick, Ohio 

OREGON 

1. Portland Public Schools — 
Area I 
Portland, Oregon 

2„ Exemplary Career Education 
Proj ect 

Springfield School District #19 
Springfield, Oregon 

PENNSYLVANIA 

1. Career Education Program 
Research for Better Schools 
Philadelphia, Pennsylvania 



* Not included in analysis because no evaluation results were submitted. 
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PENNSYLVANIA (cont . ) 



2. Selected Functional Components 
of a Vocational Education 
Counseling System for Urban 
Youth 

School District of Pittsburgh 
Pittsburgh, Pennsylvania 

TENNESSEE 

* SPAN Model Career Education 
Memphis City Schools 
MeiKphis, Tennessee 

TEXAS 

* Career Education Alternatives and 

Strategies through a Regional 
Process 

Education Service Cente"*, fteg^.on 17 
Lubbock, Texas 

WASHINGTON 

* Career Education K-12 
Seattle School District 
Seattle, Washington 

WEST VIRGINIA 

Experience Based Career Education 
Appalachia Educational Laboratory 
Charleston, West Virginia 

WISCONSIN 

1. Research and Development Project 
in Career Education 
Eau Claire Joint District #5, 

et. al. 
Eau Calire, Wisconsin 

*2. Career Education Consortium 
(no city given) 



* Not included in analysis because no evaluation results were submitted. 
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